Max level shown:
1 [ Mar 25 22:00:03 Enabled. ]
2 [ Mar 25 22:00:03 Rereading configuration. ]
3 [ Mar 25 22:00:05 Rereading configuration. ]
4 [ Mar 25 22:00:12 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/omicron-nexus/bin/nexus /var/svc/manifest/site/nexus/config.toml &"). ]
5 [ Mar 25 22:00:12 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72025-03-25T22:00:12.777ZDEBGnexus: registered DTrace probes
82025-03-25T22:00:12.779ZINFOnexus: setting up nexus server file = nexus/src/lib.rs:78
92025-03-25T22:00:12.790ZINFOnexus (ServerContext): registering Oso class class = Action file = nexus/auth/src/authz/oso_generic.rs:68
102025-03-25T22:00:12.790ZINFOnexus (ServerContext): registering Oso class class = AnyActor file = nexus/auth/src/authz/oso_generic.rs:68
112025-03-25T22:00:12.790ZINFOnexus (ServerContext): registering Oso class class = AuthenticatedActor file = nexus/auth/src/authz/oso_generic.rs:68
122025-03-25T22:00:12.790ZINFOnexus (ServerContext): registering Oso class class = BlueprintConfig file = nexus/auth/src/authz/oso_generic.rs:68
132025-03-25T22:00:12.790ZINFOnexus (ServerContext): registering Oso class class = Database file = nexus/auth/src/authz/oso_generic.rs:68
142025-03-25T22:00:12.790ZINFOnexus (ServerContext): registering Oso class class = DnsConfig file = nexus/auth/src/authz/oso_generic.rs:68
152025-03-25T22:00:12.790ZINFOnexus (ServerContext): registering Oso class class = Fleet file = nexus/auth/src/authz/oso_generic.rs:68
162025-03-25T22:00:12.790ZINFOnexus (ServerContext): registering Oso class class = Inventory file = nexus/auth/src/authz/oso_generic.rs:68
172025-03-25T22:00:12.790ZINFOnexus (ServerContext): registering Oso class class = IpPoolList file = nexus/auth/src/authz/oso_generic.rs:68
182025-03-25T22:00:12.790ZINFOnexus (ServerContext): registering Oso class class = ConsoleSessionList file = nexus/auth/src/authz/oso_generic.rs:68
192025-03-25T22:00:12.790ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequestList file = nexus/auth/src/authz/oso_generic.rs:68
202025-03-25T22:00:12.790ZINFOnexus (ServerContext): registering Oso class class = SiloCertificateList file = nexus/auth/src/authz/oso_generic.rs:68
212025-03-25T22:00:12.790ZINFOnexus (ServerContext): registering Oso class class = SiloIdentityProviderList file = nexus/auth/src/authz/oso_generic.rs:68
222025-03-25T22:00:12.790ZINFOnexus (ServerContext): registering Oso class class = SiloUserList file = nexus/auth/src/authz/oso_generic.rs:68
232025-03-25T22:00:12.790ZINFOnexus (ServerContext): registering Oso class class = TargetReleaseConfig file = nexus/auth/src/authz/oso_generic.rs:68
242025-03-25T22:00:12.790ZINFOnexus (ServerContext): registering Oso class class = Project file = nexus/auth/src/authz/oso_generic.rs:68
252025-03-25T22:00:12.790ZINFOnexus (ServerContext): registering Oso class class = Disk file = nexus/auth/src/authz/oso_generic.rs:68
262025-03-25T22:00:12.790ZINFOnexus (ServerContext): registering Oso class class = Snapshot file = nexus/auth/src/authz/oso_generic.rs:68
272025-03-25T22:00:12.790ZINFOnexus (ServerContext): registering Oso class class = ProjectImage file = nexus/auth/src/authz/oso_generic.rs:68
282025-03-25T22:00:12.790ZINFOnexus (ServerContext): registering Oso class class = AffinityGroup file = nexus/auth/src/authz/oso_generic.rs:68
292025-03-25T22:00:12.790ZINFOnexus (ServerContext): registering Oso class class = AntiAffinityGroup file = nexus/auth/src/authz/oso_generic.rs:68
302025-03-25T22:00:12.790ZINFOnexus (ServerContext): registering Oso class class = Instance file = nexus/auth/src/authz/oso_generic.rs:68
312025-03-25T22:00:12.790ZINFOnexus (ServerContext): registering Oso class class = IpPool file = nexus/auth/src/authz/oso_generic.rs:68
322025-03-25T22:00:12.790ZINFOnexus (ServerContext): registering Oso class class = InstanceNetworkInterface file = nexus/auth/src/authz/oso_generic.rs:68
332025-03-25T22:00:12.791ZINFOnexus (ServerContext): registering Oso class class = Vpc file = nexus/auth/src/authz/oso_generic.rs:68
342025-03-25T22:00:12.791ZINFOnexus (ServerContext): registering Oso class class = VpcRouter file = nexus/auth/src/authz/oso_generic.rs:68
352025-03-25T22:00:12.791ZINFOnexus (ServerContext): registering Oso class class = InternetGateway file = nexus/auth/src/authz/oso_generic.rs:68
362025-03-25T22:00:12.791ZINFOnexus (ServerContext): registering Oso class class = InternetGatewayIpPool file = nexus/auth/src/authz/oso_generic.rs:68
372025-03-25T22:00:12.791ZINFOnexus (ServerContext): registering Oso class class = InternetGatewayIpAddress file = nexus/auth/src/authz/oso_generic.rs:68
382025-03-25T22:00:12.791ZINFOnexus (ServerContext): registering Oso class class = RouterRoute file = nexus/auth/src/authz/oso_generic.rs:68
392025-03-25T22:00:12.791ZINFOnexus (ServerContext): registering Oso class class = VpcSubnet file = nexus/auth/src/authz/oso_generic.rs:68
402025-03-25T22:00:12.791ZINFOnexus (ServerContext): registering Oso class class = FloatingIp file = nexus/auth/src/authz/oso_generic.rs:68
412025-03-25T22:00:12.791ZINFOnexus (ServerContext): registering Oso class class = Image file = nexus/auth/src/authz/oso_generic.rs:68
422025-03-25T22:00:12.791ZINFOnexus (ServerContext): registering Oso class class = SiloImage file = nexus/auth/src/authz/oso_generic.rs:68
432025-03-25T22:00:12.791ZINFOnexus (ServerContext): registering Oso class class = AddressLot file = nexus/auth/src/authz/oso_generic.rs:68
442025-03-25T22:00:12.791ZINFOnexus (ServerContext): registering Oso class class = Blueprint file = nexus/auth/src/authz/oso_generic.rs:68
452025-03-25T22:00:12.791ZINFOnexus (ServerContext): registering Oso class class = LoopbackAddress file = nexus/auth/src/authz/oso_generic.rs:68
462025-03-25T22:00:12.791ZINFOnexus (ServerContext): registering Oso class class = Certificate file = nexus/auth/src/authz/oso_generic.rs:68
472025-03-25T22:00:12.791ZINFOnexus (ServerContext): registering Oso class class = ConsoleSession file = nexus/auth/src/authz/oso_generic.rs:68
482025-03-25T22:00:12.791ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequest file = nexus/auth/src/authz/oso_generic.rs:68
492025-03-25T22:00:12.791ZINFOnexus (ServerContext): registering Oso class class = DeviceAccessToken file = nexus/auth/src/authz/oso_generic.rs:68
502025-03-25T22:00:12.791ZINFOnexus (ServerContext): registering Oso class class = PhysicalDisk file = nexus/auth/src/authz/oso_generic.rs:68
512025-03-25T22:00:12.791ZINFOnexus (ServerContext): registering Oso class class = Rack file = nexus/auth/src/authz/oso_generic.rs:68
522025-03-25T22:00:12.791ZINFOnexus (ServerContext): registering Oso class class = RoleBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
532025-03-25T22:00:12.791ZINFOnexus (ServerContext): registering Oso class class = SshKey file = nexus/auth/src/authz/oso_generic.rs:68
542025-03-25T22:00:12.791ZINFOnexus (ServerContext): registering Oso class class = Silo file = nexus/auth/src/authz/oso_generic.rs:68
552025-03-25T22:00:12.791ZINFOnexus (ServerContext): registering Oso class class = SiloUser file = nexus/auth/src/authz/oso_generic.rs:68
562025-03-25T22:00:12.791ZINFOnexus (ServerContext): registering Oso class class = SiloGroup file = nexus/auth/src/authz/oso_generic.rs:68
572025-03-25T22:00:12.791ZINFOnexus (ServerContext): registering Oso class class = SupportBundle file = nexus/auth/src/authz/oso_generic.rs:68
582025-03-25T22:00:12.791ZINFOnexus (ServerContext): registering Oso class class = IdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
592025-03-25T22:00:12.791ZINFOnexus (ServerContext): registering Oso class class = SamlIdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
602025-03-25T22:00:12.791ZINFOnexus (ServerContext): registering Oso class class = Sled file = nexus/auth/src/authz/oso_generic.rs:68
612025-03-25T22:00:12.791ZINFOnexus (ServerContext): registering Oso class class = TufRepo file = nexus/auth/src/authz/oso_generic.rs:68
622025-03-25T22:00:12.791ZINFOnexus (ServerContext): registering Oso class class = TufArtifact file = nexus/auth/src/authz/oso_generic.rs:68
632025-03-25T22:00:12.791ZINFOnexus (ServerContext): registering Oso class class = Zpool file = nexus/auth/src/authz/oso_generic.rs:68
642025-03-25T22:00:12.791ZINFOnexus (ServerContext): registering Oso class class = Service file = nexus/auth/src/authz/oso_generic.rs:68
652025-03-25T22:00:12.791ZINFOnexus (ServerContext): registering Oso class class = UserBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
662025-03-25T22:00:12.791ZINFOnexus (ServerContext): full Oso configuration config = #\n# Oso configuration for Omicron\n# This file is augmented by generated snippets.\n#\n\n#\n# ACTOR TYPES AND BASIC RULES\n#\n\n# `AnyActor` includes both authenticated and unauthenticated users.\nactor AnyActor {}\n\n# An `AuthenticatedActor` has an identity in the system. All of our operations\n# today require that an actor be authenticated.\nactor AuthenticatedActor {}\n\n# For any resource, `actor` can perform action `action` on it if they're\n# authenticated and their role(s) give them the corresponding permission on that\n# resource.\nallow(actor: AnyActor, action: Action, resource) if\n actor.authenticated and\n has_permission(actor.authn_actor.unwrap(), action.to_perm(), resource);\n\n# Define role relationships\nhas_role(actor: AuthenticatedActor, role: String, resource: Resource)\n\tif resource.has_role(actor, role);\n\n#\n# ROLES AND PERMISSIONS IN THE FLEET/SILO/PROJECT HIERARCHY\n#\n# We define the following permissions for most resources in the system:\n#\n# - "create_child": required to create child resources (of any type)\n#\n# - "list_children": required to list child resources (of all types) of a\n# resource\n#\n# - "modify": required to modify or delete a resource\n#\n# - "read": required to read a resource\n#\n# We define the following predefined roles for only a few high-level resources:\n# the Fleet (see below), Silo, Organization, and Project. The specific roles\n# are oriented around intended use-cases:\n#\n# - "admin": has all permissions on the resource\n#\n# - "collaborator": has "read", "list_children", and "create_child", plus\n# the "admin" role for child resources. The idea is that if you're an\n# Organization Collaborator, you have full control over the Projects within\n# the Organization, but you cannot modify or delete the Organization itself.\n#\n# - "viewer": has "read" and "list_children" on a resource\n#\n# Below the Project level, permissions are granted via roles at the Project\n# level. For example, for someone to be able to create, modify, or delete any\n# Instances, they must be granted project.collaborator, which means they can\n# create, modify, or delete _all_ resources in the Project.\n#\n# The complete set of predefined roles:\n#\n# - fleet.admin (superuser for the whole system)\n# - fleet.collaborator (can manage Silos)\n# - fleet.viewer (can read most non-siloed resources in the system)\n# - silo.admin (superuser for the silo)\n# - silo.collaborator (can create and own Organizations)\n# - silo.viewer (can read most resources within the Silo)\n# - organization.admin (complete control over an organization)\n# - organization.collaborator (can manage Projects)\n# - organization.viewer (can read most resources within the Organization)\n# - project.admin (complete control over a Project)\n# - project.collaborator (can manage all resources within the Project)\n# - project.viewer (can read most resources within the Project)\n#\n# Outside the Silo/Organization/Project hierarchy, we (currently) treat most\n# resources as nested under Fleet or else a synthetic resource (see below). We\n# do not yet support role assignments on anything other than Fleet, Silo,\n# Organization, or Project.\n#\n\n# "Fleet" is a global singleton representing the whole system. The name comes\n# from the idea described in RFD 24, but it's not quite right. This probably\n# should be more like "Region" or "AvailabilityZone". The precise boundaries\n# have not yet been figured out.\nresource Fleet {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\troles = [\n\t # Roles that can be attached by users\n\t "admin",\n\t "collaborator",\n\t "viewer",\n\n\t # Internal-only roles\n\t "external-authenticator"\n\t];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n}\n\n# For fleets specifically, roles can be conferred by roles on the user's Silo.\nhas_role(actor: AuthenticatedActor, role: String, _: Fleet) if\n\tsilo_role in actor.confers_fleet_role(role) and\n\thas_role(actor, silo_role, actor.silo.unwrap());\n\nresource Silo {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Permissions implied by roles on this resource's parent (Fleet). Fleet\n\t# privileges allow a user to see and potentially administer the Silo,\n\t# but they do not give anyone permission to look at anything inside the\n\t# Silo. To achieve this, we use permission rules here. (If we granted\n\t# Fleet administrators _roles_ on the Silo, then those would cascade\n\t# into the Silo as well.)\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "collaborator" on "parent_fleet";\n\n\t# external authenticator has to create silo users\n\t"list_children" if "external-authenticator" on "parent_fleet";\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\n\nhas_relation(fleet: Fleet, "parent_fleet", silo: Silo)\n\tif silo.fleet = fleet;\n\n# As a special case, all authenticated users can read their own Silo. That's\n# not quite the same as having the "viewer" role. For example, they cannot list\n# Organizations in the Silo.\n#\n# One reason this is necessary is because if an unprivileged user tries to\n# create an Organization using "POST /organizations", they should get back a 403\n# (which implies they're able to see /organizations, which is essentially seeing\n# the Silo itself) rather than a 404. This behavior isn't a hard constraint\n# (i.e., you could reasonably get a 404 for an API you're not allowed to call).\n# Nor is the implementation (i.e., we could special-case this endpoint somehow).\n# But granting this permission is the simplest way to keep this endpoint's\n# behavior consistent with the rest of the API.\n#\n# This rule is also used to determine if a user can list the identity providers\n# in the Silo (which they should be able to), since that's predicated on being\n# able to read the Silo.\n#\n# It's unclear what else would break if users couldn't see their own Silo.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif silo in actor.silo;\n\nresource Project {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Roles implied by roles on this resource's parent (Silo)\n\trelations = { parent_silo: Silo };\n\t"admin" if "collaborator" on "parent_silo";\n\t"viewer" if "viewer" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", project: Project)\n\tif project.silo = silo;\n\n#\n# GENERAL RESOURCES OUTSIDE THE SILO/PROJECT HIERARCHY\n#\n# Many resources use snippets of Polar generated by the `authz_resource!` Rust\n# macro. Some resources require custom Polar code. Those appear here.\n#\n\nresource Certificate {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Fleet-level and silo-level roles both grant privileges on certificates.\n\t"read" if "admin" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", certificate: Certificate)\n\tif certificate.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", certificate: Certificate)\n\tif certificate.silo.fleet = fleet;\n\nresource SiloUser {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\t# Fleet and Silo administrators can manage a Silo's users. This is one\n\t# of the only areas of Silo configuration that Fleet Administrators have\n\t# permissions on.\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "read" on "parent_fleet";\n\t"read" if "read" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", user: SiloUser)\n\tif user.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", user: SiloUser)\n\tif user.silo.fleet = fleet;\n\n# authenticated actors have all permissions on themselves\nhas_permission(actor: AuthenticatedActor, _perm: String, silo_user: SiloUser)\n if actor.equals_silo_user(silo_user);\n\nhas_permission(actor: AuthenticatedActor, "read", silo_user: SiloUser)\n if silo_user.silo in actor.silo;\n\nresource SiloGroup {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\trelations = { parent_silo: Silo };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", group: SiloGroup)\n\tif group.silo = silo;\n\nresource SshKey {\n\tpermissions = [ "read", "modify" ];\n\trelations = { silo_user: SiloUser };\n\n\t"read" if "read" on "silo_user";\n\t"modify" if "modify" on "silo_user";\n}\nhas_relation(user: SiloUser, "silo_user", ssh_key: SshKey)\n\tif ssh_key.silo_user = user;\n\nresource IdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", identity_provider: IdentityProvider)\n\tif identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: IdentityProvider)\n\tif collection.silo.fleet = fleet;\n\nresource SamlIdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", saml_identity_provider: SamlIdentityProvider)\n\tif saml_identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SamlIdentityProvider)\n\tif collection.silo.fleet = fleet;\n\n#\n# SYNTHETIC RESOURCES OUTSIDE THE SILO HIERARCHY\n#\n# The resources here do not correspond to anything that appears explicitly in\n# the API or is stored in the database. These are used either at the top level\n# of the API path (e.g., "/v1/system/ip-pools") or as an implementation detail of the system\n# (in the case of console sessions and "Database"). The policies are\n# either statically-defined in this file or driven by role assignments on the\n# Fleet. None of these resources defines their own roles.\n#\n\n# Describes the policy for reading and modifying DNS configuration\n# (both internal and external)\nresource DnsConfig {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t# "external-authenticator" requires these permissions because that's the\n\t# context that Nexus uses when creating and deleting Silos. These\n\t# operations necessarily need to read and modify DNS configuration.\n\t"read" if "external-authenticator" on "parent_fleet";\n\t"modify" if "external-authenticator" on "parent_fleet";\n\t# "admin" on the parent fleet also gets these permissions, primarily for\n\t# the test suite.\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", dns_config: DnsConfig)\n\tif dns_config.fleet = fleet;\n\n# Describes the policy for accessing blueprints\nresource BlueprintConfig {\n\tpermissions = [\n\t "list_children", # list blueprints\n\t "create_child", # create blueprint\n\t "read", # read the current target\n\t "modify", # change the current target\n\t];\n\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"read" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", list: BlueprintConfig)\n\tif list.fleet = fleet;\n\n# Describes the policy for accessing blueprints\nresource TargetReleaseConfig {\n\tpermissions = [\n\t "read", # read the current target release\n\t "modify", # change the current target release\n\t];\n\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", resource: TargetReleaseConfig)\n\tif resource.fleet = fleet;\n\n# Describes the policy for reading and modifying low-level inventory\nresource Inventory {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", inventory: Inventory)\n\tif inventory.fleet = fleet;\n\n# Describes the policy for accessing "/v1/system/ip-pools" in the API\nresource IpPoolList {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "create_child",\n\t];\n\n\t# Fleet Administrators can create or modify the IP Pools list.\n\trelations = { parent_fleet: Fleet };\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n\n\t# Fleet Viewers can list IP Pools\n\t"list_children" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", ip_pool_list: IpPoolList)\n\tif ip_pool_list.fleet = fleet;\n\n# Any authenticated user can create a child of a provided IP Pool.\n# This is necessary to use the pools when provisioning instances.\nhas_permission(actor: AuthenticatedActor, "create_child", ip_pool: IpPool)\n\tif silo in actor.silo and silo.fleet = ip_pool.fleet;\n\n# Describes the policy for creating and managing web console sessions.\nresource ConsoleSessionList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: ConsoleSessionList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing device authorization requests.\nresource DeviceAuthRequestList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: DeviceAuthRequestList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing Silo certificates\nresource SiloCertificateList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Both Fleet and Silo administrators can see and modify the Silo's\n\t# certificates.\n\t"list_children" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloCertificateList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloCertificateList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo identity providers\nresource SiloIdentityProviderList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the identity providers in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's identity provider\n\t# configuration. This is one of the only areas of Silo configuration\n\t# that Fleet Administrators have permissions on. This is also one of\n\t# the only cases where we need to look two levels up the hierarchy to\n\t# see if somebody has the right permission. For most other things,\n\t# permissions cascade down the hierarchy so we only need to look at the\n\t# parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloIdentityProviderList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloIdentityProviderList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo users (mostly intended for\n# API-managed users)\nresource SiloUserList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the users in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's users. This is\n\t# one of the only areas of Silo configuration that Fleet Administrators\n\t# have permissions on. This is also one of the few cases (so far) where\n\t# we need to look two levels up the hierarchy to see if somebody has the\n\t# right permission. For most other things, permissions cascade down the\n\t# hierarchy so we only need to look at the parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloUserList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloUserList)\n\tif collection.silo.fleet = fleet;\n\n# These rules grants the external authenticator role the permissions it needs to\n# read silo users and modify their sessions. This is necessary for login to\n# work.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif has_role(actor, "external-authenticator", silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\n\n# All authenticated users can read and delete device authn requests because\n# by necessity these operations happen before we've figured out what user (or\n# even Silo) the device auth is associated with. Any user can claim a device\n# auth request with the right user code (that's how it works) -- it's the user\n# code and associated logic that prevents unauthorized access here.\nhas_permission(_actor: AuthenticatedActor, "read", _device_auth: DeviceAuthRequest);\nhas_permission(_actor: AuthenticatedActor, "modify", _device_auth: DeviceAuthRequest);\n\nhas_permission(actor: AuthenticatedActor, "read", device_token: DeviceAccessToken)\n\tif has_role(actor, "external-authenticator", device_token.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", identity_provider: IdentityProvider)\n\tif has_role(actor, "external-authenticator", identity_provider.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", saml_identity_provider: SamlIdentityProvider)\n\tif has_role(actor, "external-authenticator", saml_identity_provider.silo.fleet);\n\n# Describes the policy for who can access the internal database.\nresource Database {\n\tpermissions = [\n\t # "query" is required to perform any query against the database,\n\t # whether a read or write query. This is checked when an operation\n\t # checks out a database connection from the connection pool.\n\t #\n\t # Any authenticated user gets this permission. There's generally\n\t # some other authz check involved in the database query. For\n\t # example, if you're querying the database to "read" a "Project", we\n\t # should also be checking that. So why do we do this at all? It's\n\t # a belt-and-suspenders measure so that if we somehow introduced an\n\t # unauthenticated code path that hits the database, it cannot be\n\t # used to DoS the database because we won't allow the operation to\n\t # make the query. (As long as the code path _is_ authenticated, we\n\t # can use throttling mechanisms to prevent DoS.)\n\t "query",\n\n\t # "modify" is required to populate database data that's delivered\n\t # with the system. It should also be required for schema changes,\n\t # when we support those. This is separate from "query" so that we\n\t # cannot accidentally invoke these code paths from API calls and\n\t # other general functions.\n\t "modify"\n\t];\n}\n\n# All authenticated users have the "query" permission on the database.\nhas_permission(_actor: AuthenticatedActor, "query", _resource: Database);\n\n# The "db-init" user is the only one with the "modify" permission.\nhas_permission(USER_DB_INIT: AuthenticatedActor, "modify", _resource: Database);\nhas_permission(USER_DB_INIT: AuthenticatedActor, "create_child", _resource: IpPoolList);\n# It also has "admin" on the internal silo to populate it with built-in resources.\n# TODO-completeness: actually limit to just internal silo and not all silos\nhas_role(USER_DB_INIT: AuthenticatedActor, "admin", _silo: Silo);\n\n# Allow the internal API admin permissions on all silos.\nhas_role(USER_INTERNAL_API: AuthenticatedActor, "admin", _silo: Silo);\n\n\n\n resource Disk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Disk)\n if child.project = parent;\n \n\n resource Snapshot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Snapshot)\n if child.project = parent;\n \n\n resource ProjectImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: ProjectImage)\n if child.project = parent;\n \n\n resource AffinityGroup {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: AffinityGroup)\n if child.project = parent;\n \n\n resource AntiAffinityGroup {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: AntiAffinityGroup)\n if child.project = parent;\n \n\n resource Instance {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Instance)\n if child.project = parent;\n \n\n resource IpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: IpPool)\n if child.fleet = fleet;\n \n\n resource InstanceNetworkInterface {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Instance\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InstanceNetworkInterface)\n if has_relation(project, "containing_project", child.instance);\n\n has_relation(parent: Instance, "parent", child: InstanceNetworkInterface)\n if child.instance = parent;\n \n\n resource Vpc {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Vpc)\n if child.project = parent;\n \n\n resource VpcRouter {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcRouter)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcRouter)\n if child.vpc = parent;\n \n\n resource InternetGateway {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGateway)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: InternetGateway)\n if child.vpc = parent;\n \n\n resource InternetGatewayIpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpPool)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpPool)\n if child.internet_gateway = parent;\n \n\n resource InternetGatewayIpAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpAddress)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpAddress)\n if child.internet_gateway = parent;\n \n\n resource RouterRoute {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: VpcRouter\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: RouterRoute)\n if has_relation(project, "containing_project", child.vpc_router);\n\n has_relation(parent: VpcRouter, "parent", child: RouterRoute)\n if child.vpc_router = parent;\n \n\n resource VpcSubnet {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcSubnet)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcSubnet)\n if child.vpc = parent;\n \n\n resource FloatingIp {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: FloatingIp)\n if child.project = parent;\n \n\n resource Image {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: Image)\n if child.silo = parent;\n \n\n resource SiloImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: SiloImage)\n if child.silo = parent;\n \n\n resource AddressLot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: AddressLot)\n if child.fleet = fleet;\n \n\n resource Blueprint {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Blueprint)\n if child.fleet = fleet;\n \n\n resource LoopbackAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: LoopbackAddress)\n if child.fleet = fleet;\n \n\n\n resource ConsoleSession {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: ConsoleSession)\n if child.fleet = fleet;\n \n\n resource DeviceAuthRequest {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAuthRequest)\n if child.fleet = fleet;\n \n\n resource DeviceAccessToken {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAccessToken)\n if child.fleet = fleet;\n \n\n resource PhysicalDisk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: PhysicalDisk)\n if child.fleet = fleet;\n \n\n resource Rack {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Rack)\n if child.fleet = fleet;\n \n\n resource RoleBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: RoleBuiltin)\n if child.fleet = fleet;\n \n\n\n\n\n\n resource SupportBundle {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: SupportBundle)\n if child.fleet = fleet;\n \n\n\n\n resource Sled {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Sled)\n if child.fleet = fleet;\n \n\n resource TufRepo {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufRepo)\n if child.fleet = fleet;\n \n\n resource TufArtifact {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufArtifact)\n if child.fleet = fleet;\n \n\n resource Zpool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Zpool)\n if child.fleet = fleet;\n \n\n resource Service {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Service)\n if child.fleet = fleet;\n \n\n resource UserBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: UserBuiltin)\n if child.fleet = fleet;\n file = nexus/auth/src/authz/oso_generic.rs:89
672025-03-25T22:00:12.807ZINFOnexus (ServerContext): Setting up resolver using DNS servers for subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344::, width: 48 } } file = nexus/src/context.rs:222
682025-03-25T22:00:12.809ZINFOnexus (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
692025-03-25T22:00:12.814ZINFOnexus (ServerContext): Setting up qorb database pool from DNS dns_addrs = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = nexus/src/context.rs:278
702025-03-25T22:00:12.819ZDEBGnexus (ServerContext): registered USDT probes
712025-03-25T22:00:13.482ZINFOnexus: Database schema version is up to date desired_version = 131.0.0 file = nexus/db-queries/src/db/datastore/db_metadata.rs:144 found_version = 131.0.0
722025-03-25T22:00:13.486ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6166, tv_nsec: 822854458 } })
732025-03-25T22:00:13.486ZINFOnexus (SEC): SEC running file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:813 sec_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
742025-03-25T22:00:13.486ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1171
752025-03-25T22:00:13.563ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
762025-03-25T22:00:13.563ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
772025-03-25T22:00:13.568ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "972ec64f-798b-411b-b3ae-44f206128cda", "content-length": "26", "date": "Tue, 25 Mar 2025 22:00:12 GMT"} })
782025-03-25T22:00:13.568ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
792025-03-25T22:00:13.569ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
802025-03-25T22:00:13.601ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6166, tv_nsec: 938340405 } })
812025-03-25T22:00:13.601ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1171
822025-03-25T22:00:13.634ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
832025-03-25T22:00:13.634ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
842025-03-25T22:00:13.634ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b217afd-1a97-4996-aac0-d3f0e3f3ea51", "content-length": "26", "date": "Tue, 25 Mar 2025 22:00:13 GMT"} })
852025-03-25T22:00:13.634ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
862025-03-25T22:00:13.635ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
872025-03-25T22:00:13.703ZDEBGnexus (clickhouse-client): registered USDT probes id = d08a408b-d97d-4320-be74-5456b041d36f
882025-03-25T22:00:13.721ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
892025-03-25T22:00:13.727ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
902025-03-25T22:00:13.734ZDEBGnexus (DataLoader): attempting to create built-in users
912025-03-25T22:00:13.734ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
922025-03-25T22:00:13.734ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
932025-03-25T22:00:13.744ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /bgtasks versions = all
942025-03-25T22:00:13.744ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /bgtasks/activate versions = all
952025-03-25T22:00:13.744ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /bgtasks/view/{bgtask_name} versions = all
962025-03-25T22:00:13.744ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /clickhouse/policy versions = all
972025-03-25T22:00:13.744ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /clickhouse/policy versions = all
982025-03-25T22:00:13.744ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stop-request versions = all
992025-03-25T22:00:13.744ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stopped versions = all
1002025-03-25T22:00:13.744ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair/{repair_id}/progress versions = all
1012025-03-25T22:00:13.744ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-finish versions = all
1022025-03-25T22:00:13.744ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-start versions = all
1032025-03-25T22:00:13.744ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /demo-saga versions = all
1042025-03-25T22:00:13.744ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /demo-saga/{demo_saga_id}/complete versions = all
1052025-03-25T22:00:13.744ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /deployment/blueprints/all versions = all
1062025-03-25T22:00:13.744ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = DELETE path = /deployment/blueprints/all/{blueprint_id} versions = all
1072025-03-25T22:00:13.744ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /deployment/blueprints/all/{blueprint_id} versions = all
1082025-03-25T22:00:13.744ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /deployment/blueprints/import versions = all
1092025-03-25T22:00:13.744ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /deployment/blueprints/regenerate versions = all
1102025-03-25T22:00:13.744ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /deployment/blueprints/target versions = all
1112025-03-25T22:00:13.744ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /deployment/blueprints/target versions = all
1122025-03-25T22:00:13.744ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /deployment/blueprints/target/enabled versions = all
1132025-03-25T22:00:13.744ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /disk/{disk_id}/remove-read-only-parent versions = all
1142025-03-25T22:00:13.744ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /disks/{disk_id} versions = all
1152025-03-25T22:00:13.744ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /instances/{instance_id}/migrate versions = all
1162025-03-25T22:00:13.744ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /metrics/collectors versions = all
1172025-03-25T22:00:13.744ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /metrics/collectors/{collector_id}/producers versions = all
1182025-03-25T22:00:13.744ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /metrics/producers versions = all
1192025-03-25T22:00:13.744ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /nat/ipv4/changeset/{from_gen} versions = all
1202025-03-25T22:00:13.744ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /physical-disk/expunge versions = all
1212025-03-25T22:00:13.744ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /probes/{sled} versions = all
1222025-03-25T22:00:13.744ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /racks/{rack_id}/initialization-complete versions = all
1232025-03-25T22:00:13.744ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sagas versions = all
1242025-03-25T22:00:13.744ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sagas/{saga_id} versions = all
1252025-03-25T22:00:13.745ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sled-agents/{sled_id} versions = all
1262025-03-25T22:00:13.745ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sled-agents/{sled_id} versions = all
1272025-03-25T22:00:13.745ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sled-agents/{sled_id}/firewall-rules-update versions = all
1282025-03-25T22:00:13.745ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sleds/add versions = all
1292025-03-25T22:00:13.745ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sleds/expunge versions = all
1302025-03-25T22:00:13.745ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sleds/uninitialized versions = all
1312025-03-25T22:00:13.745ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /switch/{switch_id} versions = all
1322025-03-25T22:00:13.745ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /vmms/{propolis_id} versions = all
1332025-03-25T22:00:13.745ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /volume/{volume_id}/remove-read-only-parent versions = all
1342025-03-25T22:00:13.745ZINFOnexus (dropshot_internal): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fd00:1122:3344:101::c]:12221
1352025-03-25T22:00:13.745ZDEBGnexus (dropshot_internal): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:12221
1362025-03-25T22:00:13.745ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
1372025-03-25T22:00:13.745ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
1382025-03-25T22:00:13.750ZINFOnexus (DataLoader): created 0 built-in users file = nexus/db-queries/src/db/datastore/silo_user.rs:394
1392025-03-25T22:00:13.750ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1402025-03-25T22:00:13.751ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1412025-03-25T22:00:13.752ZDEBGnexus (DataLoader): attempting to create built-in roles
1422025-03-25T22:00:13.752ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1432025-03-25T22:00:13.752ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1442025-03-25T22:00:13.797ZINFOnexus (DataLoader): created 0 built-in roles file = nexus/db-queries/src/db/datastore/role.rs:84
1452025-03-25T22:00:13.797ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1462025-03-25T22:00:13.798ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1472025-03-25T22:00:13.798ZDEBGnexus (DataLoader): attempting to create built-in role assignments
1482025-03-25T22:00:13.798ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1492025-03-25T22:00:13.798ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1502025-03-25T22:00:14.305ZWARNnexus: Cannot look up rack: Object (of type ById(c7210e4b-5a81-4ec8-b8fe-816a9508dc74)) not found: rack file = nexus/src/app/rack.rs:776
1512025-03-25T22:00:16.307ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
1522025-03-25T22:00:16.307ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
1532025-03-25T22:00:16.530ZWARNnexus: Cannot look up rack: Object (of type ById(c7210e4b-5a81-4ec8-b8fe-816a9508dc74)) not found: rack file = nexus/src/app/rack.rs:776
1542025-03-25T22:00:16.847ZINFOnexus (DataLoader): created 0 built-in role assignments file = nexus/db-queries/src/db/datastore/role.rs:113
1552025-03-25T22:00:16.847ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1562025-03-25T22:00:16.848ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1572025-03-25T22:00:16.848ZDEBGnexus (DataLoader): attempting to create built-in silos
1582025-03-25T22:00:16.848ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1592025-03-25T22:00:16.848ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1602025-03-25T22:00:16.945ZINFOnexus (DataLoader): created 0 built-in silos file = nexus/db-queries/src/db/datastore/silo.rs:93
1612025-03-25T22:00:16.945ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1622025-03-25T22:00:16.946ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1632025-03-25T22:00:16.956ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1642025-03-25T22:00:16.957ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1652025-03-25T22:00:16.957ZDEBGnexus (DataLoader): attempting to create built-in projects
1662025-03-25T22:00:16.957ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1672025-03-25T22:00:16.957ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1682025-03-25T22:00:17.182ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1692025-03-25T22:00:17.182ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1702025-03-25T22:00:17.915ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1712025-03-25T22:00:17.915ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1722025-03-25T22:00:17.953ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1732025-03-25T22:00:17.955ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1742025-03-25T22:00:17.955ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1752025-03-25T22:00:17.955ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1762025-03-25T22:00:17.957ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1772025-03-25T22:00:17.957ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1782025-03-25T22:00:18.531ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
1792025-03-25T22:00:18.531ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
1802025-03-25T22:00:18.533ZWARNnexus: Cannot look up rack: Object (of type ById(c7210e4b-5a81-4ec8-b8fe-816a9508dc74)) not found: rack file = nexus/src/app/rack.rs:776
1812025-03-25T22:00:18.715ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:52653
1822025-03-25T22:00:18.720ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52653 req_id = dec2e0b8-cbad-4b54-b01c-1bc5ebbd7140 roles = RoleSet { roles: {} } uri = /sled-agents/f034aaf6-2037-4cb4-8409-3ab31c15cc28
1832025-03-25T22:00:18.720ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52653 req_id = dec2e0b8-cbad-4b54-b01c-1bc5ebbd7140 resource = Database result = Ok(()) uri = /sled-agents/f034aaf6-2037-4cb4-8409-3ab31c15cc28
1842025-03-25T22:00:18.783ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "f034aaf6-2037-4cb4-8409-3ab31c15cc28" error_message_internal = not found: sled with id "f034aaf6-2037-4cb4-8409-3ab31c15cc28" file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 67267 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52653 req_id = dec2e0b8-cbad-4b54-b01c-1bc5ebbd7140 response_code = 404 uri = /sled-agents/f034aaf6-2037-4cb4-8409-3ab31c15cc28
1852025-03-25T22:00:18.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52653 req_id = 524ee149-f7f9-47f6-9a00-f05541f34283 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
1862025-03-25T22:00:18.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52653 req_id = 524ee149-f7f9-47f6-9a00-f05541f34283 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
1872025-03-25T22:00:18.799ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9349 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52653 req_id = 524ee149-f7f9-47f6-9a00-f05541f34283 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
1882025-03-25T22:00:19.778ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1892025-03-25T22:00:19.779ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1902025-03-25T22:00:19.779ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1912025-03-25T22:00:19.779ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1922025-03-25T22:00:19.829ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52653 req_id = 563b2310-207b-4e28-9b86-f3a4413c4dcc roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
1932025-03-25T22:00:19.830ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52653 req_id = 563b2310-207b-4e28-9b86-f3a4413c4dcc resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
1942025-03-25T22:00:19.848ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 18638 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52653 req_id = 563b2310-207b-4e28-9b86-f3a4413c4dcc response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
1952025-03-25T22:00:19.910ZINFOnexus (DataLoader): created built-in services project file = nexus/db-queries/src/db/datastore/project.rs:122
1962025-03-25T22:00:19.911ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1972025-03-25T22:00:19.912ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1982025-03-25T22:00:19.912ZDEBGnexus (DataLoader): attempting to create built-in VPCs
1992025-03-25T22:00:19.912ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2002025-03-25T22:00:19.912ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2012025-03-25T22:00:19.994ZINFOnexus: registered sled agent file = nexus/src/app/sled.rs:58 sled_uuid = f034aaf6-2037-4cb4-8409-3ab31c15cc28
2022025-03-25T22:00:20.002ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2032025-03-25T22:00:20.003ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2042025-03-25T22:00:20.042ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2052025-03-25T22:00:20.043ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2062025-03-25T22:00:20.044ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2072025-03-25T22:00:20.045ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2082025-03-25T22:00:20.046ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2092025-03-25T22:00:20.047ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2102025-03-25T22:00:20.078ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2112025-03-25T22:00:20.081ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
2122025-03-25T22:00:20.081ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2132025-03-25T22:00:20.081ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2142025-03-25T22:00:20.122ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 130955 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52653 req_id = d8e147ca-f9c6-4d9f-9bd0-1021a405408e response_code = 204 uri = /sled-agents/f034aaf6-2037-4cb4-8409-3ab31c15cc28
2152025-03-25T22:00:20.122ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2162025-03-25T22:00:20.123ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2172025-03-25T22:00:20.124ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2182025-03-25T22:00:20.124ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2192025-03-25T22:00:20.126ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2202025-03-25T22:00:20.128ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
2212025-03-25T22:00:20.128ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2222025-03-25T22:00:20.128ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2232025-03-25T22:00:20.150ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2242025-03-25T22:00:20.150ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2252025-03-25T22:00:20.151ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2262025-03-25T22:00:20.151ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2272025-03-25T22:00:20.153ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2282025-03-25T22:00:20.153ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2292025-03-25T22:00:20.155ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2302025-03-25T22:00:20.158ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") } result = Ok(())
2312025-03-25T22:00:20.158ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2322025-03-25T22:00:20.158ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2332025-03-25T22:00:20.173ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2342025-03-25T22:00:20.173ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2352025-03-25T22:00:20.175ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2362025-03-25T22:00:20.176ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2372025-03-25T22:00:20.206ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2382025-03-25T22:00:20.206ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2392025-03-25T22:00:20.208ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2402025-03-25T22:00:20.208ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2412025-03-25T22:00:20.210ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2422025-03-25T22:00:20.210ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2432025-03-25T22:00:20.211ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2442025-03-25T22:00:20.211ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2452025-03-25T22:00:20.213ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2462025-03-25T22:00:20.213ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2472025-03-25T22:00:20.214ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2482025-03-25T22:00:20.217ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2492025-03-25T22:00:20.217ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2502025-03-25T22:00:20.217ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2512025-03-25T22:00:20.219ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2522025-03-25T22:00:20.219ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2532025-03-25T22:00:20.220ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2542025-03-25T22:00:20.220ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2552025-03-25T22:00:20.221ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2562025-03-25T22:00:20.225ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2572025-03-25T22:00:20.225ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2582025-03-25T22:00:20.225ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2592025-03-25T22:00:20.335ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2602025-03-25T22:00:20.335ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2612025-03-25T22:00:20.337ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2622025-03-25T22:00:20.337ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2632025-03-25T22:00:20.338ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2642025-03-25T22:00:20.339ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2652025-03-25T22:00:20.342ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2662025-03-25T22:00:20.345ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2672025-03-25T22:00:20.345ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2682025-03-25T22:00:20.345ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2692025-03-25T22:00:20.403ZDEBGnexus (DataLoader): attempting to create built-in VPC firewall rules
2702025-03-25T22:00:20.403ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2712025-03-25T22:00:20.404ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2722025-03-25T22:00:20.406ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2732025-03-25T22:00:20.406ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2742025-03-25T22:00:20.407ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2752025-03-25T22:00:20.408ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2762025-03-25T22:00:20.409ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2772025-03-25T22:00:20.410ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2782025-03-25T22:00:20.411ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2792025-03-25T22:00:20.411ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2802025-03-25T22:00:20.413ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2812025-03-25T22:00:20.413ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2822025-03-25T22:00:20.414ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2832025-03-25T22:00:20.417ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2842025-03-25T22:00:20.417ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2852025-03-25T22:00:20.417ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2862025-03-25T22:00:20.418ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2872025-03-25T22:00:20.418ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2882025-03-25T22:00:20.420ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2892025-03-25T22:00:20.420ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2902025-03-25T22:00:20.421ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2912025-03-25T22:00:20.424ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2922025-03-25T22:00:20.424ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2932025-03-25T22:00:20.425ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2942025-03-25T22:00:20.428ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2952025-03-25T22:00:20.428ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2962025-03-25T22:00:20.430ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2972025-03-25T22:00:20.430ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2982025-03-25T22:00:20.431ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2992025-03-25T22:00:20.431ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3002025-03-25T22:00:20.433ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3012025-03-25T22:00:20.436ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3022025-03-25T22:00:20.436ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3032025-03-25T22:00:20.436ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3042025-03-25T22:00:20.535ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
3052025-03-25T22:00:20.535ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
3062025-03-25T22:00:20.536ZWARNnexus: Cannot look up rack: Object (of type ById(c7210e4b-5a81-4ec8-b8fe-816a9508dc74)) not found: rack file = nexus/src/app/rack.rs:776
3072025-03-25T22:00:20.547ZWARNnexus (datastore): Retryable transaction failure file = nexus/db-queries/src/transaction_retry.rs:165 retry_after (ms) = 19 transaction = vpc_update_firewall_rules
3082025-03-25T22:00:20.583ZINFOnexus (datastore): transaction completed attempts = 2 file = nexus/db-queries/src/transaction_retry.rs:121 transaction = vpc_update_firewall_rules
3092025-03-25T22:00:20.583ZINFOnexus (DataLoader): created built-in VPC firewall rules file = nexus/db-queries/src/db/datastore/vpc.rs:284
3102025-03-25T22:00:20.583ZDEBGnexus (DataLoader): attempting to create built-in VPC Subnets
3112025-03-25T22:00:20.583ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3122025-03-25T22:00:20.583ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3132025-03-25T22:00:20.610ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3142025-03-25T22:00:20.610ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3152025-03-25T22:00:20.611ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3162025-03-25T22:00:20.612ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3172025-03-25T22:00:20.613ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3182025-03-25T22:00:20.614ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3192025-03-25T22:00:20.615ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3202025-03-25T22:00:20.615ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3212025-03-25T22:00:20.617ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3222025-03-25T22:00:20.617ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3232025-03-25T22:00:20.619ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3242025-03-25T22:00:20.621ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3252025-03-25T22:00:20.621ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3262025-03-25T22:00:20.622ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3272025-03-25T22:00:20.623ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3282025-03-25T22:00:20.623ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3292025-03-25T22:00:20.625ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3302025-03-25T22:00:20.625ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3312025-03-25T22:00:20.627ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3322025-03-25T22:00:20.627ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3332025-03-25T22:00:20.629ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3342025-03-25T22:00:20.629ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3352025-03-25T22:00:20.633ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3362025-03-25T22:00:20.633ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3372025-03-25T22:00:20.634ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3382025-03-25T22:00:20.634ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3392025-03-25T22:00:20.636ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3402025-03-25T22:00:20.639ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ById(001de000-c470-4000-8000-000000000001) } result = Ok(())
3412025-03-25T22:00:20.639ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3422025-03-25T22:00:20.640ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3432025-03-25T22:00:20.646ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3442025-03-25T22:00:20.646ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3452025-03-25T22:00:20.647ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3462025-03-25T22:00:20.647ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3472025-03-25T22:00:20.649ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3482025-03-25T22:00:20.649ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3492025-03-25T22:00:20.650ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3502025-03-25T22:00:20.653ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3512025-03-25T22:00:20.695ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3522025-03-25T22:00:20.696ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3532025-03-25T22:00:20.697ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3542025-03-25T22:00:20.697ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3552025-03-25T22:00:20.699ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3562025-03-25T22:00:20.699ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3572025-03-25T22:00:20.700ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3582025-03-25T22:00:20.704ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
3592025-03-25T22:00:20.704ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3602025-03-25T22:00:20.704ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3612025-03-25T22:00:20.802ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3622025-03-25T22:00:20.802ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3632025-03-25T22:00:20.804ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3642025-03-25T22:00:20.804ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3652025-03-25T22:00:20.806ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3662025-03-25T22:00:20.806ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3672025-03-25T22:00:20.808ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3682025-03-25T22:00:20.808ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3692025-03-25T22:00:20.810ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3702025-03-25T22:00:20.810ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3712025-03-25T22:00:20.811ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3722025-03-25T22:00:20.811ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3732025-03-25T22:00:20.812ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3742025-03-25T22:00:20.813ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3752025-03-25T22:00:20.814ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3762025-03-25T22:00:20.818ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000003, lookup_type: ById(001de000-c470-4000-8000-000000000003) } result = Ok(())
3772025-03-25T22:00:20.818ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3782025-03-25T22:00:20.818ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3792025-03-25T22:00:20.824ZINFOnexus (DataLoader): created built-in services vpc subnets file = nexus/db-queries/src/db/datastore/vpc.rs:350
3802025-03-25T22:00:20.824ZINFOnexus (DataLoader): created built-in services vpc file = nexus/db-queries/src/db/datastore/vpc.rs:226
3812025-03-25T22:00:20.824ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3822025-03-25T22:00:20.825ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3832025-03-25T22:00:20.825ZDEBGnexus (DataLoader): attempting to create silo users
3842025-03-25T22:00:20.825ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3852025-03-25T22:00:20.825ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3862025-03-25T22:00:20.827ZINFOnexus (DataLoader): created 0 silo users file = nexus/db-queries/src/db/datastore/silo_user.rs:419
3872025-03-25T22:00:20.827ZDEBGnexus (DataLoader): attempting to create silo user role assignments
3882025-03-25T22:00:20.827ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3892025-03-25T22:00:20.827ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3902025-03-25T22:00:20.828ZINFOnexus (DataLoader): created 0 silo user role assignments file = nexus/db-queries/src/db/datastore/silo_user.rs:446
3912025-03-25T22:00:20.828ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3922025-03-25T22:00:20.828ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3932025-03-25T22:00:20.830ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3942025-03-25T22:00:20.830ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3952025-03-25T22:00:20.835ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3962025-03-25T22:00:20.835ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3972025-03-25T22:00:20.837ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3982025-03-25T22:00:20.838ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = IpPoolList result = Ok(())
3992025-03-25T22:00:20.838ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
4002025-03-25T22:00:20.838ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4012025-03-25T22:00:20.840ZINFOnexus: populate complete file = nexus/src/app/mod.rs:545
4022025-03-25T22:00:20.840ZINFOnexus: activating background tasks file = nexus/src/app/mod.rs:554
4032025-03-25T22:00:20.842ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 1 reason = Signaled
4042025-03-25T22:00:20.843ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 1 reason = Timeout
4052025-03-25T22:00:20.843ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 1 reason = Timeout
4062025-03-25T22:00:20.843ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 1 reason = Timeout
4072025-03-25T22:00:20.843ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 1 reason = Timeout
4082025-03-25T22:00:20.843ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 1 reason = Timeout
4092025-03-25T22:00:20.843ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
4102025-03-25T22:00:20.843ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-03-25 21:50:20.843373787 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
4112025-03-25T22:00:20.843ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 1 reason = Timeout
4122025-03-25T22:00:20.843ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 1 reason = Timeout
4132025-03-25T22:00:20.843ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 1 reason = Timeout
4142025-03-25T22:00:20.843ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 1 reason = Timeout
4152025-03-25T22:00:20.843ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 1 reason = Timeout
4162025-03-25T22:00:20.843ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 1 reason = Timeout
4172025-03-25T22:00:20.843ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
4182025-03-25T22:00:20.843ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4192025-03-25T22:00:20.843ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 1 reason = Timeout
4202025-03-25T22:00:20.843ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
4212025-03-25T22:00:20.843ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 1 reason = Timeout
4222025-03-25T22:00:20.843ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4232025-03-25T22:00:20.843ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 1 reason = Timeout
4242025-03-25T22:00:20.843ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 1 reason = Timeout
4252025-03-25T22:00:20.843ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 1 reason = Timeout
4262025-03-25T22:00:20.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 1 reason = Timeout
4272025-03-25T22:00:20.843ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 1 reason = Timeout
4282025-03-25T22:00:20.843ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
4292025-03-25T22:00:20.843ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
4302025-03-25T22:00:20.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 1 reason = Timeout
4312025-03-25T22:00:20.843ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 1 reason = Timeout
4322025-03-25T22:00:20.843ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
4332025-03-25T22:00:20.843ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 1 reason = Timeout
4342025-03-25T22:00:20.843ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 1 reason = Timeout
4352025-03-25T22:00:20.843ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
4362025-03-25T22:00:20.843ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 1 reason = Timeout
4372025-03-25T22:00:20.843ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4382025-03-25T22:00:20.843ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
4392025-03-25T22:00:20.843ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 1 reason = Timeout
4402025-03-25T22:00:20.843ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:73 reason = no blueprint
4412025-03-25T22:00:20.843ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 1 reason = Timeout
4422025-03-25T22:00:20.843ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 1 reason = Timeout
4432025-03-25T22:00:20.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4442025-03-25T22:00:20.843ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 1 reason = Timeout
4452025-03-25T22:00:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
4462025-03-25T22:00:20.843ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 1 reason = Timeout
4472025-03-25T22:00:20.843ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 1 reason = Timeout
4482025-03-25T22:00:20.843ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 1 reason = Timeout
4492025-03-25T22:00:20.843ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = crdb_node_id_collector file = nexus/src/app/background/tasks/crdb_node_id_collector.rs:78 reason = no blueprint
4502025-03-25T22:00:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
4512025-03-25T22:00:20.843ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 1 reason = Timeout
4522025-03-25T22:00:20.843ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
4532025-03-25T22:00:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4542025-03-25T22:00:20.844ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
4552025-03-25T22:00:20.844ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
4562025-03-25T22:00:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
4572025-03-25T22:00:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
4582025-03-25T22:00:20.844ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4592025-03-25T22:00:20.845ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 1.183421ms iteration = 1 status = {"error":"no blueprint"}
4602025-03-25T22:00:20.845ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 1.203791ms iteration = 1 status = {"error":"no config nor servers"}
4612025-03-25T22:00:20.845ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 1.048808ms iteration = 1 status = {"error":"no blueprint"}
4622025-03-25T22:00:20.845ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
4632025-03-25T22:00:20.845ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
4642025-03-25T22:00:20.846ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4652025-03-25T22:00:20.846ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4662025-03-25T22:00:20.846ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4672025-03-25T22:00:20.846ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4682025-03-25T22:00:20.846ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4692025-03-25T22:00:20.846ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
4702025-03-25T22:00:20.846ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 1 reason = Timeout
4712025-03-25T22:00:20.846ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4722025-03-25T22:00:20.846ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
4732025-03-25T22:00:20.846ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4742025-03-25T22:00:20.846ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4752025-03-25T22:00:20.846ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4762025-03-25T22:00:20.846ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
4772025-03-25T22:00:20.846ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
4782025-03-25T22:00:20.846ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 1 reason = Timeout
4792025-03-25T22:00:20.846ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
4802025-03-25T22:00:20.846ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 1 reason = Timeout
4812025-03-25T22:00:20.846ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
4822025-03-25T22:00:20.846ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
4832025-03-25T22:00:20.847ZWARNnexus (BackgroundTasks): Blueprint rendezvous: skipped background_task = blueprint_rendezvous file = nexus/src/app/background/tasks/blueprint_rendezvous.rs:52 reason = no blueprint
4842025-03-25T22:00:20.847ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 3.301557ms iteration = 1 status = {"error":"no blueprint"}
4852025-03-25T22:00:20.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
4862025-03-25T22:00:20.847ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 1 reason = Timeout
4872025-03-25T22:00:20.847ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 1 reason = Timeout
4882025-03-25T22:00:20.847ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
4892025-03-25T22:00:20.847ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 3.528752ms iteration = 1 status = {"error":"no config nor servers"}
4902025-03-25T22:00:20.847ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
4912025-03-25T22:00:20.847ZDEBGnexus (BackgroundTasks): activating background_task = tuf_artifact_replication iteration = 1 reason = Timeout
4922025-03-25T22:00:20.847ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
4932025-03-25T22:00:20.847ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
4942025-03-25T22:00:20.847ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5533f428-2028-4269-b7b1-f15912c01133.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("66b022b6-2e12-413e-b4b7-56c4ad5bdd77.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f337d25b-c67a-4a32-89e1-e187aea97ed9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f337d25b-c67a-4a32-89e1-e187aea97ed9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 6174, tv_nsec: 184448770 } })
4952025-03-25T22:00:20.847ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4962025-03-25T22:00:20.848ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("58d382a7-99da-40a7-bc9f-2da7e9b156c1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d42076c6-06fe-4102-a978-c7d0a8dffb98.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d42076c6-06fe-4102-a978-c7d0a8dffb98.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 6174, tv_nsec: 185185033 } })
4972025-03-25T22:00:20.849ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external dns_group = external file = nexus/src/app/background/tasks/dns_servers.rs:113
4982025-03-25T22:00:20.849ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal dns_group = internal file = nexus/src/app/background/tasks/dns_servers.rs:113
4992025-03-25T22:00:20.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5002025-03-25T22:00:20.849ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 6.079766ms iteration = 1 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
5012025-03-25T22:00:20.849ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 6.238759ms iteration = 1 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
5022025-03-25T22:00:20.849ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 2 reason = Dependency
5032025-03-25T22:00:20.849ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
5042025-03-25T22:00:20.849ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 2 reason = Dependency
5052025-03-25T22:00:20.849ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
5062025-03-25T22:00:20.849ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 21.11\u{b5}s iteration = 2 status = {"error":"no config"}
5072025-03-25T22:00:20.849ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 16.281\u{b5}s iteration = 2 status = {"error":"no config"}
5082025-03-25T22:00:20.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
5092025-03-25T22:00:20.850ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5102025-03-25T22:00:20.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5112025-03-25T22:00:20.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
5122025-03-25T22:00:20.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5132025-03-25T22:00:20.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5142025-03-25T22:00:20.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5152025-03-25T22:00:20.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5162025-03-25T22:00:20.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5172025-03-25T22:00:20.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
5182025-03-25T22:00:20.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
5192025-03-25T22:00:20.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
5202025-03-25T22:00:20.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
5212025-03-25T22:00:20.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
5222025-03-25T22:00:20.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5232025-03-25T22:00:20.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5242025-03-25T22:00:20.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
5252025-03-25T22:00:20.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5262025-03-25T22:00:20.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
5272025-03-25T22:00:20.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
5282025-03-25T22:00:20.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5292025-03-25T22:00:20.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
5302025-03-25T22:00:20.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5312025-03-25T22:00:20.854ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
5322025-03-25T22:00:20.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5332025-03-25T22:00:20.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
5342025-03-25T22:00:20.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5352025-03-25T22:00:20.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5362025-03-25T22:00:20.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5372025-03-25T22:00:20.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5382025-03-25T22:00:20.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5392025-03-25T22:00:20.869ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52653 req_id = 596d8bf5-ae39-46b6-b450-cb9e8cdf97c5 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
5402025-03-25T22:00:20.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52653 req_id = 596d8bf5-ae39-46b6-b450-cb9e8cdf97c5 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
5412025-03-25T22:00:20.872ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5422025-03-25T22:00:20.872ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5432025-03-25T22:00:20.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5442025-03-25T22:00:20.874ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5452025-03-25T22:00:20.874ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5462025-03-25T22:00:20.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5472025-03-25T22:00:20.887ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5482025-03-25T22:00:20.890ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5492025-03-25T22:00:20.890ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5502025-03-25T22:00:20.890ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5512025-03-25T22:00:20.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5522025-03-25T22:00:20.893ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
5532025-03-25T22:00:20.893ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
5542025-03-25T22:00:20.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
5552025-03-25T22:00:20.896ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5562025-03-25T22:00:20.896ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-03-25 21:50:20.843373787 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
5572025-03-25T22:00:20.896ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 53.393433ms iteration = 1 status = {"expiration":"2025-03-25T21:50:20.843373787Z","pruned":[]}
5582025-03-25T22:00:20.899ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5592025-03-25T22:00:20.899ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5602025-03-25T22:00:20.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5612025-03-25T22:00:20.904ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6174, tv_nsec: 241047629 } })
5622025-03-25T22:00:20.904ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1171
5632025-03-25T22:00:20.933ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5642025-03-25T22:00:20.936ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
5652025-03-25T22:00:20.936ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
5662025-03-25T22:00:20.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
5672025-03-25T22:00:20.950ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
5682025-03-25T22:00:20.950ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
5692025-03-25T22:00:20.952ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d312c4d-02dd-4da2-b317-8663a2903e2d", "content-length": "26", "date": "Tue, 25 Mar 2025 22:00:20 GMT"} })
5702025-03-25T22:00:20.953ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
5712025-03-25T22:00:20.953ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 110.453249ms iteration = 1 status = {"errors":[],"finish_invoked_ok":[]}
5722025-03-25T22:00:20.953ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5732025-03-25T22:00:20.954ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
5742025-03-25T22:00:20.954ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 110.958988ms iteration = 1 status = {"errors":[],"garbage_collect_requested":[]}
5752025-03-25T22:00:20.956ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5762025-03-25T22:00:20.956ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 112.81986ms iteration = 1 status = {"errors":[],"found_port_ok":[]}
5772025-03-25T22:00:20.956ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5782025-03-25T22:00:20.956ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5792025-03-25T22:00:20.956ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
5802025-03-25T22:00:20.956ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5812025-03-25T22:00:20.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5822025-03-25T22:00:20.959ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
5832025-03-25T22:00:20.959ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
5842025-03-25T22:00:20.959ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
5852025-03-25T22:00:20.959ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5862025-03-25T22:00:20.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5872025-03-25T22:00:20.959ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
5882025-03-25T22:00:20.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5892025-03-25T22:00:20.959ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
5902025-03-25T22:00:20.959ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
5912025-03-25T22:00:20.959ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5922025-03-25T22:00:20.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5932025-03-25T22:00:20.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
5942025-03-25T22:00:20.960ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
5952025-03-25T22:00:20.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5962025-03-25T22:00:20.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5972025-03-25T22:00:20.960ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5982025-03-25T22:00:20.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5992025-03-25T22:00:20.962ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 118.893127ms iteration = 1 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
6002025-03-25T22:00:20.963ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6012025-03-25T22:00:20.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6022025-03-25T22:00:20.965ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6032025-03-25T22:00:20.965ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:80 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
6042025-03-25T22:00:20.965ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 121.940771ms iteration = 1 status = {"error":"rack not yet initialized: c7210e4b-5a81-4ec8-b8fe-816a9508dc74"}
6052025-03-25T22:00:20.966ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 122.829896ms iteration = 1 status = {}
6062025-03-25T22:00:20.966ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
6072025-03-25T22:00:20.966ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
6082025-03-25T22:00:20.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
6092025-03-25T22:00:20.999ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
6102025-03-25T22:00:20.999ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 156.191168ms iteration = 1 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
6112025-03-25T22:00:21.002ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6174, tv_nsec: 339429038 } })
6122025-03-25T22:00:21.003ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1171
6132025-03-25T22:00:21.006ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6142025-03-25T22:00:21.009ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
6152025-03-25T22:00:21.011ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
6162025-03-25T22:00:21.011ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6172025-03-25T22:00:21.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6182025-03-25T22:00:21.011ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6192025-03-25T22:00:21.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6202025-03-25T22:00:21.013ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6212025-03-25T22:00:21.013ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
6222025-03-25T22:00:21.013ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6232025-03-25T22:00:21.013ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "f583fa3d-104d-4a68-b0fc-5b7836a965c5", "content-length": "1", "date": "Tue, 25 Mar 2025 22:00:20 GMT"} })
6242025-03-25T22:00:21.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6252025-03-25T22:00:21.015ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6262025-03-25T22:00:21.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 145916 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52653 req_id = 596d8bf5-ae39-46b6-b450-cb9e8cdf97c5 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
6272025-03-25T22:00:21.015ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6282025-03-25T22:00:21.015ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6292025-03-25T22:00:21.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6302025-03-25T22:00:21.019ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6312025-03-25T22:00:21.020ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
6322025-03-25T22:00:21.022ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6332025-03-25T22:00:21.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6342025-03-25T22:00:21.024ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6352025-03-25T22:00:21.025ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6362025-03-25T22:00:21.025ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
6372025-03-25T22:00:21.025ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6382025-03-25T22:00:21.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6392025-03-25T22:00:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
6402025-03-25T22:00:21.028ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6412025-03-25T22:00:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6422025-03-25T22:00:21.031ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6432025-03-25T22:00:21.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6442025-03-25T22:00:21.034ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
6452025-03-25T22:00:21.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
6462025-03-25T22:00:21.043ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
6472025-03-25T22:00:21.043ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 199.683128ms iteration = 1 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
6482025-03-25T22:00:21.044ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
6492025-03-25T22:00:21.044ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 200.93164ms iteration = 1 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
6502025-03-25T22:00:21.052ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 208.628284ms iteration = 1 status = {"errors":[],"requests_created_ok":[]}
6512025-03-25T22:00:21.055ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = []
6522025-03-25T22:00:21.056ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6174, tv_nsec: 393119166 } })
6532025-03-25T22:00:21.058ZWARNnexus (BackgroundTasks): inventory collection is None background_task = service_zone_nat_tracker file = nexus/src/app/background/tasks/sync_service_zone_nat.rs:95
6542025-03-25T22:00:21.058ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 214.383485ms iteration = 1 status = {"error":"inventory collection is None"}
6552025-03-25T22:00:21.058ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
6562025-03-25T22:00:21.058ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
6572025-03-25T22:00:21.058ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 214.756942ms iteration = 1 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
6582025-03-25T22:00:21.060ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
6592025-03-25T22:00:21.060ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6602025-03-25T22:00:21.061ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f8a897b0-71a8-424c-a1bb-68c261bf5d7c", "content-length": "26", "date": "Tue, 25 Mar 2025 22:00:20 GMT"} })
6612025-03-25T22:00:21.061ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6622025-03-25T22:00:21.063ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6632025-03-25T22:00:21.089ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6642025-03-25T22:00:21.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6652025-03-25T22:00:21.090ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 246.779841ms iteration = 1 status = null
6662025-03-25T22:00:21.090ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
6672025-03-25T22:00:21.090ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6682025-03-25T22:00:21.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6692025-03-25T22:00:21.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
6702025-03-25T22:00:21.094ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
6712025-03-25T22:00:21.094ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
6722025-03-25T22:00:21.094ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 250.636348ms iteration = 1 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
6732025-03-25T22:00:21.102ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 258.656878ms iteration = 1 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6742025-03-25T22:00:21.103ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
6752025-03-25T22:00:21.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
6762025-03-25T22:00:21.105ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_external dns_group = external error = Internal Error: expected exactly one latest version for DNS group External, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
6772025-03-25T22:00:21.105ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 262.023887ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group External, found 0"}
6782025-03-25T22:00:21.106ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6792025-03-25T22:00:21.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
6802025-03-25T22:00:21.109ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
6812025-03-25T22:00:21.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
6822025-03-25T22:00:21.148ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
6832025-03-25T22:00:21.148ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
6842025-03-25T22:00:21.148ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
6852025-03-25T22:00:21.149ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "6eedbdf5-728b-4970-8e5e-e03f4ad0fd51", "content-length": "476", "date": "Tue, 25 Mar 2025 22:00:20 GMT"} })
6862025-03-25T22:00:21.149ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6872025-03-25T22:00:21.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6882025-03-25T22:00:21.152ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6892025-03-25T22:00:21.155ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
6902025-03-25T22:00:21.156ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e95e0a5-795b-4a96-bf25-340cbe9fdc95", "content-length": "734", "date": "Tue, 25 Mar 2025 22:00:20 GMT"} })
6912025-03-25T22:00:21.157ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
6922025-03-25T22:00:21.158ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 314.28877ms iteration = 1 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
6932025-03-25T22:00:21.158ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0dea84f-925d-42f1-850b-57a272d4aac8", "content-length": "111", "date": "Tue, 25 Mar 2025 22:00:20 GMT"} })
6942025-03-25T22:00:21.158ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_internal dns_group = internal error = Internal Error: expected exactly one latest version for DNS group Internal, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
6952025-03-25T22:00:21.158ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 315.352129ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group Internal, found 0"}
6962025-03-25T22:00:21.159ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
6972025-03-25T22:00:21.159ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "65ad520e-51aa-4102-9177-b6e9e7a344c4", "content-length": "111", "date": "Tue, 25 Mar 2025 22:00:20 GMT"} })
6982025-03-25T22:00:21.159ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
6992025-03-25T22:00:21.160ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
7002025-03-25T22:00:21.160ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7012025-03-25T22:00:21.161ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd1d52d2-fa28-4d05-a8c7-165e8e2eb5be", "content-length": "167", "date": "Tue, 25 Mar 2025 22:00:20 GMT"} })
7022025-03-25T22:00:21.161ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
7032025-03-25T22:00:21.162ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "800aa575-3d92-478b-89f5-98af93e4604e", "content-length": "167", "date": "Tue, 25 Mar 2025 22:00:20 GMT"} })
7042025-03-25T22:00:21.162ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
7052025-03-25T22:00:21.162ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "cdf8ddb9-7338-40c2-b2a6-db8918fb05bd", "content-length": "175", "date": "Tue, 25 Mar 2025 22:00:20 GMT"} })
7062025-03-25T22:00:21.162ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
7072025-03-25T22:00:21.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7082025-03-25T22:00:21.163ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "32f0000f-c98e-4ee9-bf3c-99293d2001cf", "content-length": "175", "date": "Tue, 25 Mar 2025 22:00:20 GMT"} })
7092025-03-25T22:00:21.163ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
7102025-03-25T22:00:21.164ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0399436c-ab65-4728-b11a-9d688d0021ca", "content-length": "702", "date": "Tue, 25 Mar 2025 22:00:20 GMT"} })
7112025-03-25T22:00:21.164ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
7122025-03-25T22:00:21.168ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 324.773393ms iteration = 1 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
7132025-03-25T22:00:21.174ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7142025-03-25T22:00:21.176ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c2751a4-3773-4102-87c2-3aa948d4d1b6", "content-length": "727", "date": "Tue, 25 Mar 2025 22:00:20 GMT"} })
7152025-03-25T22:00:21.177ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
7162025-03-25T22:00:21.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7172025-03-25T22:00:21.177ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "24ce3c2d-2b74-49df-b4e8-92573d4de4f8", "content-length": "729", "date": "Tue, 25 Mar 2025 22:00:21 GMT"} })
7182025-03-25T22:00:21.177ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
7192025-03-25T22:00:21.178ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2471250b-401e-481b-ba0c-c63696e63713", "content-length": "728", "date": "Tue, 25 Mar 2025 22:00:21 GMT"} })
7202025-03-25T22:00:21.178ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
7212025-03-25T22:00:21.178ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "790150a3-fe08-40b0-96e7-3be1152a78f3", "content-length": "722", "date": "Tue, 25 Mar 2025 22:00:21 GMT"} })
7222025-03-25T22:00:21.178ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
7232025-03-25T22:00:21.179ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6520dbb2-dc0a-4ccf-80ac-3ea23f33403a", "content-length": "109", "date": "Tue, 25 Mar 2025 22:00:21 GMT"} })
7242025-03-25T22:00:21.179ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
7252025-03-25T22:00:21.179ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a88f8d7-5031-4cd0-9203-eceeb17b9c65", "content-length": "109", "date": "Tue, 25 Mar 2025 22:00:21 GMT"} })
7262025-03-25T22:00:21.179ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
7272025-03-25T22:00:21.180ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "55fc8a3b-80f8-45a1-b4be-ee98aee59fd9", "content-length": "169", "date": "Tue, 25 Mar 2025 22:00:21 GMT"} })
7282025-03-25T22:00:21.180ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
7292025-03-25T22:00:21.180ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae91f55b-c5ad-4e17-b4bd-435527a6fcb0", "content-length": "169", "date": "Tue, 25 Mar 2025 22:00:21 GMT"} })
7302025-03-25T22:00:21.180ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
7312025-03-25T22:00:21.181ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4eb46015-0195-414e-bbbb-09b9a41e511f", "content-length": "178", "date": "Tue, 25 Mar 2025 22:00:21 GMT"} })
7322025-03-25T22:00:21.181ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
7332025-03-25T22:00:21.181ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1578e932-f017-4a9f-ab1d-6291de4fc717", "content-length": "178", "date": "Tue, 25 Mar 2025 22:00:21 GMT"} })
7342025-03-25T22:00:21.181ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
7352025-03-25T22:00:21.181ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c9311788-8971-4be4-9ff5-15948ae636f8", "content-length": "702", "date": "Tue, 25 Mar 2025 22:00:21 GMT"} })
7362025-03-25T22:00:21.181ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
7372025-03-25T22:00:21.181ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "40f7c0e9-8295-47f0-b8c6-dbae11de1e2b", "content-length": "727", "date": "Tue, 25 Mar 2025 22:00:21 GMT"} })
7382025-03-25T22:00:21.181ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
7392025-03-25T22:00:21.182ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1496f926-ac5c-447d-a88e-5c6de6bc5bb4", "content-length": "729", "date": "Tue, 25 Mar 2025 22:00:20 GMT"} })
7402025-03-25T22:00:21.182ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
7412025-03-25T22:00:21.182ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "218130cc-0532-4dbf-b47f-d679203b613a", "content-length": "728", "date": "Tue, 25 Mar 2025 22:00:21 GMT"} })
7422025-03-25T22:00:21.182ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7432025-03-25T22:00:21.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7442025-03-25T22:00:21.193ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7452025-03-25T22:00:21.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7462025-03-25T22:00:21.196ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 352.668221ms iteration = 1 status = {}
7472025-03-25T22:00:21.201ZWARNnexus (BackgroundTasks): failed to read Silo/DNS/TLS configuration background_task = external_endpoints error = Internal Error: expected at least one external DNS zone file = nexus/src/app/background/tasks/external_endpoints.rs:48
7482025-03-25T22:00:21.201ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 357.75708ms iteration = 1 status = {"error":"failed to read Silo/DNS/TLS configuration: Internal Error: expected at least one external DNS zone"}
7492025-03-25T22:00:21.205ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7502025-03-25T22:00:21.205ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
7512025-03-25T22:00:21.205ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 361.838681ms iteration = 1 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
7522025-03-25T22:00:21.229ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 386.364569ms iteration = 1 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
7532025-03-25T22:00:21.241ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
7542025-03-25T22:00:21.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
7552025-03-25T22:00:21.251ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:360
7562025-03-25T22:00:21.251ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 408.021468ms iteration = 1 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
7572025-03-25T22:00:21.256ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
7582025-03-25T22:00:21.256ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7592025-03-25T22:00:21.258ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a2b9773-bb0c-47ae-acee-4cd9ebe18af9", "content-length": "312", "date": "Tue, 25 Mar 2025 22:00:21 GMT"} })
7602025-03-25T22:00:21.258ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7612025-03-25T22:00:21.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7622025-03-25T22:00:21.259ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7632025-03-25T22:00:21.259ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7642025-03-25T22:00:21.260ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7652025-03-25T22:00:21.262ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
7662025-03-25T22:00:21.262ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7672025-03-25T22:00:21.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7682025-03-25T22:00:21.263ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
7692025-03-25T22:00:21.263ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
7702025-03-25T22:00:21.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
7712025-03-25T22:00:21.263ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7722025-03-25T22:00:21.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7732025-03-25T22:00:21.265ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
7742025-03-25T22:00:21.265ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7752025-03-25T22:00:21.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7762025-03-25T22:00:21.275ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7772025-03-25T22:00:21.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7782025-03-25T22:00:21.277ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7792025-03-25T22:00:21.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7802025-03-25T22:00:21.278ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
7812025-03-25T22:00:21.278ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 435.554679ms iteration = 1 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
7822025-03-25T22:00:21.279ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7832025-03-25T22:00:21.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7842025-03-25T22:00:21.283ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7852025-03-25T22:00:21.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7862025-03-25T22:00:21.285ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7872025-03-25T22:00:21.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7882025-03-25T22:00:21.287ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7892025-03-25T22:00:21.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7902025-03-25T22:00:21.289ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7912025-03-25T22:00:21.289ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
7922025-03-25T22:00:21.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
7932025-03-25T22:00:21.292ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
7942025-03-25T22:00:21.293ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7952025-03-25T22:00:21.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7962025-03-25T22:00:21.295ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7972025-03-25T22:00:21.296ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7982025-03-25T22:00:21.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7992025-03-25T22:00:21.298ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
8002025-03-25T22:00:21.298ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
8012025-03-25T22:00:21.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
8022025-03-25T22:00:21.300ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8032025-03-25T22:00:21.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8042025-03-25T22:00:21.304ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8052025-03-25T22:00:21.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8062025-03-25T22:00:21.307ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8072025-03-25T22:00:21.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8082025-03-25T22:00:21.309ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8092025-03-25T22:00:21.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8102025-03-25T22:00:21.311ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = tuf_artifact_replication body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/artifacts-config
8112025-03-25T22:00:21.311ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8122025-03-25T22:00:21.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8132025-03-25T22:00:21.313ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8142025-03-25T22:00:21.320ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
8152025-03-25T22:00:21.320ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8162025-03-25T22:00:21.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8172025-03-25T22:00:21.321ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts-config", status: 204, headers: {"x-request-id": "0da201e0-01d9-41e4-814e-1592f719dc54", "date": "Tue, 25 Mar 2025 22:00:21 GMT"} })
8182025-03-25T22:00:21.321ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = tuf_artifact_replication body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/artifacts
8192025-03-25T22:00:21.322ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8202025-03-25T22:00:21.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8212025-03-25T22:00:21.323ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts", status: 200, headers: {"content-type": "application/json", "x-request-id": "b3c71fb8-22ac-4970-a224-2736a8e48111", "content-length": "26", "date": "Tue, 25 Mar 2025 22:00:21 GMT"} })
8222025-03-25T22:00:21.323ZINFOnexus (BackgroundTasks): Successfully got artifact list background_task = tuf_artifact_replication file = nexus/src/app/background/tasks/tuf_artifact_replication.rs:673 sled = http://[fd00:1122:3344:101::1]:12345
8232025-03-25T22:00:21.324ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8242025-03-25T22:00:21.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8252025-03-25T22:00:21.326ZDEBGnexus (BackgroundTasks): activation complete background_task = tuf_artifact_replication elapsed = 482.393627ms iteration = 1 status = {"generation":1,"last_run_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":1,"put_config_err":0,"put_config_ok":1,"put_err":0,"put_ok":0},"lifetime_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":1,"put_config_err":0,"put_config_ok":1,"put_err":0,"put_ok":0},"local_repos":0,"request_debug_ringbuf":[{"generation":1,"operation":"put_config","target_sled":"f034aaf6-2037-4cb4-8409-3ab31c15cc28","time":"2025-03-25T22:00:21.321183573Z"},{"operation":"list","target_sled":"f034aaf6-2037-4cb4-8409-3ab31c15cc28","time":"2025-03-25T22:00:21.323912581Z"}]}
8262025-03-25T22:00:21.326ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8272025-03-25T22:00:21.327ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8282025-03-25T22:00:21.330ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
8292025-03-25T22:00:21.330ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
8302025-03-25T22:00:21.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
8312025-03-25T22:00:21.332ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
8322025-03-25T22:00:21.332ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8332025-03-25T22:00:21.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8342025-03-25T22:00:21.337ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8352025-03-25T22:00:21.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8362025-03-25T22:00:21.339ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8372025-03-25T22:00:21.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8382025-03-25T22:00:21.344ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8392025-03-25T22:00:21.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8402025-03-25T22:00:21.356ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8412025-03-25T22:00:21.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8422025-03-25T22:00:21.376ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
8432025-03-25T22:00:21.376ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
8442025-03-25T22:00:21.379ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8452025-03-25T22:00:21.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8462025-03-25T22:00:21.381ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
8472025-03-25T22:00:21.381ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
8482025-03-25T22:00:21.386ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1ea103fe-e28a-49ce-9d9a-03d184808102", "date": "Tue, 25 Mar 2025 22:00:21 GMT"} })
8492025-03-25T22:00:21.388ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8502025-03-25T22:00:21.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8512025-03-25T22:00:21.391ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8522025-03-25T22:00:21.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8532025-03-25T22:00:21.399ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8542025-03-25T22:00:21.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8552025-03-25T22:00:21.406ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8562025-03-25T22:00:21.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8572025-03-25T22:00:21.410ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8582025-03-25T22:00:21.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8592025-03-25T22:00:21.411ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8602025-03-25T22:00:21.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8612025-03-25T22:00:21.419ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8622025-03-25T22:00:21.421ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8632025-03-25T22:00:21.421ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8642025-03-25T22:00:21.421ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8652025-03-25T22:00:21.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8662025-03-25T22:00:21.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8672025-03-25T22:00:21.423ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8682025-03-25T22:00:21.424ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8692025-03-25T22:00:21.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8702025-03-25T22:00:21.425ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8712025-03-25T22:00:21.425ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8722025-03-25T22:00:21.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8732025-03-25T22:00:21.426ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8742025-03-25T22:00:21.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8752025-03-25T22:00:21.427ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8762025-03-25T22:00:21.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8772025-03-25T22:00:21.428ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8782025-03-25T22:00:21.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8792025-03-25T22:00:21.429ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8802025-03-25T22:00:21.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8812025-03-25T22:00:21.430ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8822025-03-25T22:00:21.435ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
8832025-03-25T22:00:21.435ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8842025-03-25T22:00:21.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8852025-03-25T22:00:21.469ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8862025-03-25T22:00:21.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8872025-03-25T22:00:21.471ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8882025-03-25T22:00:21.475ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
8892025-03-25T22:00:21.475ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8902025-03-25T22:00:21.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8912025-03-25T22:00:21.477ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8922025-03-25T22:00:21.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8932025-03-25T22:00:21.478ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8942025-03-25T22:00:21.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8952025-03-25T22:00:21.480ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8962025-03-25T22:00:21.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8972025-03-25T22:00:21.480ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8982025-03-25T22:00:21.486ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
8992025-03-25T22:00:21.486ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9002025-03-25T22:00:21.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9012025-03-25T22:00:21.490ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9022025-03-25T22:00:21.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9032025-03-25T22:00:21.492ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9042025-03-25T22:00:21.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9052025-03-25T22:00:21.494ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9062025-03-25T22:00:21.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9072025-03-25T22:00:21.497ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9082025-03-25T22:00:21.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9092025-03-25T22:00:21.499ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9102025-03-25T22:00:21.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9112025-03-25T22:00:21.518ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9122025-03-25T22:00:21.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9132025-03-25T22:00:21.536ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
9142025-03-25T22:00:21.539ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9152025-03-25T22:00:21.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9162025-03-25T22:00:21.541ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9172025-03-25T22:00:21.541ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4890b8f7-241c-4de4-8928-f395b3167cc7", "content-length": "691", "date": "Tue, 25 Mar 2025 22:00:21 GMT"} })
9182025-03-25T22:00:21.541ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
9192025-03-25T22:00:21.541ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
9202025-03-25T22:00:21.541ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
9212025-03-25T22:00:21.542ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 698.904609ms iteration = 1 status = {}
9222025-03-25T22:00:21.545ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9232025-03-25T22:00:21.545ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
9242025-03-25T22:00:21.545ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9252025-03-25T22:00:21.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9262025-03-25T22:00:21.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9272025-03-25T22:00:21.553ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
9282025-03-25T22:00:21.553ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9292025-03-25T22:00:21.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9302025-03-25T22:00:21.555ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9312025-03-25T22:00:21.557ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
9322025-03-25T22:00:21.557ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9332025-03-25T22:00:21.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9342025-03-25T22:00:21.559ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
9352025-03-25T22:00:21.560ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = []
9362025-03-25T22:00:21.560ZDEBGnexus (service-firewall-rule-progator): resolved 0 rules for sleds background_task = service_firewall_rule_propagation
9372025-03-25T22:00:21.583ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9382025-03-25T22:00:21.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ById(001de000-c470-4000-8000-000000000002) } result = Ok(())
9392025-03-25T22:00:21.587ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9402025-03-25T22:00:21.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9412025-03-25T22:00:21.589ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9422025-03-25T22:00:21.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9432025-03-25T22:00:21.598ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9442025-03-25T22:00:21.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9452025-03-25T22:00:21.600ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9462025-03-25T22:00:21.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9472025-03-25T22:00:21.602ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9482025-03-25T22:00:21.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9492025-03-25T22:00:21.603ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9502025-03-25T22:00:21.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9512025-03-25T22:00:21.605ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9522025-03-25T22:00:21.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9532025-03-25T22:00:21.606ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9542025-03-25T22:00:21.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000003, lookup_type: ById(001de000-c470-4000-8000-000000000003) } result = Ok(())
9552025-03-25T22:00:21.610ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9562025-03-25T22:00:21.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9572025-03-25T22:00:21.612ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9582025-03-25T22:00:21.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9592025-03-25T22:00:21.614ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9602025-03-25T22:00:21.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9612025-03-25T22:00:21.616ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9622025-03-25T22:00:21.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9632025-03-25T22:00:21.617ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9642025-03-25T22:00:21.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9652025-03-25T22:00:21.619ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9662025-03-25T22:00:21.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9672025-03-25T22:00:21.621ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9682025-03-25T22:00:21.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9692025-03-25T22:00:21.623ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9702025-03-25T22:00:21.627ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ById(001de000-c470-4000-8000-000000000001) } result = Ok(())
9712025-03-25T22:00:21.627ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9722025-03-25T22:00:21.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9732025-03-25T22:00:21.629ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9742025-03-25T22:00:21.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9752025-03-25T22:00:21.631ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9762025-03-25T22:00:21.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9772025-03-25T22:00:21.632ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9782025-03-25T22:00:21.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9792025-03-25T22:00:21.634ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9802025-03-25T22:00:21.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9812025-03-25T22:00:21.636ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9822025-03-25T22:00:21.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9832025-03-25T22:00:21.637ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9842025-03-25T22:00:21.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9852025-03-25T22:00:21.639ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9862025-03-25T22:00:21.645ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
9872025-03-25T22:00:21.645ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9882025-03-25T22:00:21.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9892025-03-25T22:00:21.646ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9902025-03-25T22:00:21.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9912025-03-25T22:00:21.648ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9922025-03-25T22:00:21.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9932025-03-25T22:00:21.651ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9942025-03-25T22:00:21.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9952025-03-25T22:00:21.654ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9962025-03-25T22:00:21.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9972025-03-25T22:00:21.655ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9982025-03-25T22:00:21.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9992025-03-25T22:00:21.657ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10002025-03-25T22:00:21.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10012025-03-25T22:00:21.659ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10022025-03-25T22:00:21.664ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000003, lookup_type: ByName("boundary-ntp") } result = Ok(())
10032025-03-25T22:00:21.664ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10042025-03-25T22:00:21.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10052025-03-25T22:00:21.666ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10062025-03-25T22:00:21.666ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = []
10072025-03-25T22:00:21.666ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
10082025-03-25T22:00:21.666ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 0 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
10092025-03-25T22:00:21.666ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 822.68355ms
10102025-03-25T22:00:21.666ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 823.335032ms iteration = 1 status = {}
10112025-03-25T22:00:21.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10122025-03-25T22:00:21.668ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10132025-03-25T22:00:21.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10142025-03-25T22:00:21.670ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10152025-03-25T22:00:21.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10162025-03-25T22:00:21.672ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10172025-03-25T22:00:21.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10182025-03-25T22:00:21.673ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10192025-03-25T22:00:21.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10202025-03-25T22:00:21.675ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10212025-03-25T22:00:21.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10222025-03-25T22:00:21.677ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10232025-03-25T22:00:21.681ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
10242025-03-25T22:00:21.681ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10252025-03-25T22:00:21.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10262025-03-25T22:00:21.683ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10272025-03-25T22:00:21.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10282025-03-25T22:00:21.684ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10292025-03-25T22:00:21.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10302025-03-25T22:00:21.686ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10312025-03-25T22:00:21.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10322025-03-25T22:00:21.688ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10332025-03-25T22:00:21.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10342025-03-25T22:00:21.690ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10352025-03-25T22:00:21.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10362025-03-25T22:00:21.691ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10372025-03-25T22:00:21.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10382025-03-25T22:00:21.693ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10392025-03-25T22:00:21.698ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = InternetGateway { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000002, lookup_type: ByName("default") } result = Ok(())
10402025-03-25T22:00:21.699ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
10412025-03-25T22:00:21.700ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "5521cdf3-0012-44af-b38b-0dc3856ebf1b", "date": "Tue, 25 Mar 2025 22:00:21 GMT"} })
10422025-03-25T22:00:21.701ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 857.915476ms iteration = 1 status = {}
10432025-03-25T22:00:21.838ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "b24a78d9-579f-4388-968d-1ae0ba9804c4", "content-length": "31956", "date": "Tue, 25 Mar 2025 22:00:21 GMT"} })
10442025-03-25T22:00:21.843ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
10452025-03-25T22:00:21.844ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
10462025-03-25T22:00:21.844ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
10472025-03-25T22:00:21.845ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
10482025-03-25T22:00:21.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
10492025-03-25T22:00:21.848ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10502025-03-25T22:00:21.850ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
10512025-03-25T22:00:21.850ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
10522025-03-25T22:00:21.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
10532025-03-25T22:00:22.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52653 req_id = 8293c0e4-cd83-40f8-a00a-228875e65080 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
10542025-03-25T22:00:22.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52653 req_id = 8293c0e4-cd83-40f8-a00a-228875e65080 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
10552025-03-25T22:00:22.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5968 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52653 req_id = 8293c0e4-cd83-40f8-a00a-228875e65080 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
10562025-03-25T22:00:22.057ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:57063
10572025-03-25T22:00:22.143ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 1fee85af-624b-4020-8db5-4ab469ddc15c file = nexus/db-queries/src/db/datastore/inventory.rs:1010
10582025-03-25T22:00:22.143ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 1fee85af-624b-4020-8db5-4ab469ddc15c time_started = 2025-03-25 22:00:21.147149 UTC
10592025-03-25T22:00:22.143ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.30127341s iteration = 1 status = {"collection_id":"1fee85af-624b-4020-8db5-4ab469ddc15c","time_done":"2025-03-25 22:00:21.844015 UTC","time_started":"2025-03-25 22:00:21.147149 UTC"}
10602025-03-25T22:00:22.143ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 2 reason = Dependency
10612025-03-25T22:00:22.143ZWARNnexus (BackgroundTasks): Blueprint rendezvous: skipped background_task = blueprint_rendezvous file = nexus/src/app/background/tasks/blueprint_rendezvous.rs:52 reason = no blueprint
10622025-03-25T22:00:22.143ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 2 reason = Timeout
10632025-03-25T22:00:22.143ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 15.911\u{b5}s iteration = 2 status = {"error":"no blueprint"}
10642025-03-25T22:00:22.143ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
10652025-03-25T22:00:22.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
10662025-03-25T22:00:22.144ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 2 reason = Dependency
10672025-03-25T22:00:22.144ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10682025-03-25T22:00:22.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10692025-03-25T22:00:22.145ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10702025-03-25T22:00:22.146ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10712025-03-25T22:00:22.148ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10722025-03-25T22:00:22.148ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10732025-03-25T22:00:22.148ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
10742025-03-25T22:00:22.148ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
10752025-03-25T22:00:22.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10762025-03-25T22:00:22.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
10772025-03-25T22:00:22.150ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:80 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
10782025-03-25T22:00:22.150ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 6.522343ms iteration = 2 status = {"error":"rack not yet initialized: c7210e4b-5a81-4ec8-b8fe-816a9508dc74"}
10792025-03-25T22:00:22.169ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(1fee85af-624b-4020-8db5-4ab469ddc15c, 0)]
10802025-03-25T22:00:22.169ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6175, tv_nsec: 506480594 } })
10812025-03-25T22:00:22.203ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
10822025-03-25T22:00:22.203ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
10832025-03-25T22:00:22.203ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
10842025-03-25T22:00:22.203ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "691badc2-3f6e-48d6-a3ec-008530b2a361", "content-length": "476", "date": "Tue, 25 Mar 2025 22:00:21 GMT"} })
10852025-03-25T22:00:22.203ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
10862025-03-25T22:00:22.204ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a10b37d-795a-4420-9ab2-6a92d05e8e51", "content-length": "734", "date": "Tue, 25 Mar 2025 22:00:21 GMT"} })
10872025-03-25T22:00:22.204ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
10882025-03-25T22:00:22.204ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab34670b-a58c-480d-89bb-7720ff0c2f8b", "content-length": "111", "date": "Tue, 25 Mar 2025 22:00:21 GMT"} })
10892025-03-25T22:00:22.204ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
10902025-03-25T22:00:22.204ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "48194cbe-1d60-4829-a133-4398c5791dbc", "content-length": "111", "date": "Tue, 25 Mar 2025 22:00:21 GMT"} })
10912025-03-25T22:00:22.204ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
10922025-03-25T22:00:22.205ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "bfd669d7-1dd9-4db3-94a8-e082e5b4c965", "content-length": "167", "date": "Tue, 25 Mar 2025 22:00:21 GMT"} })
10932025-03-25T22:00:22.205ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
10942025-03-25T22:00:22.205ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "aae9a96b-1628-4202-8203-338334cf503c", "content-length": "167", "date": "Tue, 25 Mar 2025 22:00:21 GMT"} })
10952025-03-25T22:00:22.205ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
10962025-03-25T22:00:22.205ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b80b1bc1-94d2-4c8e-bb29-ad29cb769726", "content-length": "175", "date": "Tue, 25 Mar 2025 22:00:21 GMT"} })
10972025-03-25T22:00:22.205ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
10982025-03-25T22:00:22.206ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7df3de5-a4f1-45ed-bb28-01e2d6eca60a", "content-length": "175", "date": "Tue, 25 Mar 2025 22:00:21 GMT"} })
10992025-03-25T22:00:22.206ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
11002025-03-25T22:00:22.206ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "05fa29dc-73e5-49ee-becd-3069534c441c", "content-length": "702", "date": "Tue, 25 Mar 2025 22:00:21 GMT"} })
11012025-03-25T22:00:22.206ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
11022025-03-25T22:00:22.207ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e9062657-efc5-4ade-adc9-30c16a3af097", "content-length": "727", "date": "Tue, 25 Mar 2025 22:00:21 GMT"} })
11032025-03-25T22:00:22.207ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
11042025-03-25T22:00:22.207ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f7419de-0089-46a7-8c1c-06f39c0b92d3", "content-length": "729", "date": "Tue, 25 Mar 2025 22:00:22 GMT"} })
11052025-03-25T22:00:22.207ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
11062025-03-25T22:00:22.207ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "192ee80d-33d6-4442-a325-372302f85289", "content-length": "728", "date": "Tue, 25 Mar 2025 22:00:22 GMT"} })
11072025-03-25T22:00:22.207ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
11082025-03-25T22:00:22.207ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "feb6251d-cf21-45cb-b539-40e74bcbe57e", "content-length": "722", "date": "Tue, 25 Mar 2025 22:00:22 GMT"} })
11092025-03-25T22:00:22.207ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
11102025-03-25T22:00:22.207ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6191be7-1fe2-4dd0-b68f-820e11dbcfa2", "content-length": "109", "date": "Tue, 25 Mar 2025 22:00:22 GMT"} })
11112025-03-25T22:00:22.207ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
11122025-03-25T22:00:22.208ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3334b60-70b4-43b3-a5ba-b99593c12b6e", "content-length": "109", "date": "Tue, 25 Mar 2025 22:00:22 GMT"} })
11132025-03-25T22:00:22.208ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
11142025-03-25T22:00:22.208ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a6e52cd-1252-435d-a370-ee2a131b0ce3", "content-length": "169", "date": "Tue, 25 Mar 2025 22:00:22 GMT"} })
11152025-03-25T22:00:22.208ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
11162025-03-25T22:00:22.208ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "712f64a3-c387-4fe7-b3d1-9751cff3633c", "content-length": "169", "date": "Tue, 25 Mar 2025 22:00:22 GMT"} })
11172025-03-25T22:00:22.208ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
11182025-03-25T22:00:22.208ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "84f6fff3-ed84-43a9-9392-e2266c220da7", "content-length": "178", "date": "Tue, 25 Mar 2025 22:00:22 GMT"} })
11192025-03-25T22:00:22.208ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
11202025-03-25T22:00:22.209ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c4983249-8535-4d50-80d1-72ee687164ec", "content-length": "178", "date": "Tue, 25 Mar 2025 22:00:22 GMT"} })
11212025-03-25T22:00:22.209ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
11222025-03-25T22:00:22.209ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a1c9024f-5d3d-47d8-bc0e-f17c2e190a18", "content-length": "702", "date": "Tue, 25 Mar 2025 22:00:22 GMT"} })
11232025-03-25T22:00:22.209ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
11242025-03-25T22:00:22.209ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "27613f0f-beff-4935-aeba-2f774cf6f795", "content-length": "727", "date": "Tue, 25 Mar 2025 22:00:22 GMT"} })
11252025-03-25T22:00:22.209ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
11262025-03-25T22:00:22.209ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "37e1bf3f-4caa-4cea-8047-35bf51d2ca34", "content-length": "729", "date": "Tue, 25 Mar 2025 22:00:22 GMT"} })
11272025-03-25T22:00:22.209ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
11282025-03-25T22:00:22.209ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ffc17ad-59fc-47a6-93b8-549c103bd2b1", "content-length": "728", "date": "Tue, 25 Mar 2025 22:00:21 GMT"} })
11292025-03-25T22:00:22.209ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
11302025-03-25T22:00:22.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
11312025-03-25T22:00:22.212ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11322025-03-25T22:00:22.214ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
11332025-03-25T22:00:22.214ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
11342025-03-25T22:00:22.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
11352025-03-25T22:00:22.216ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11362025-03-25T22:00:22.218ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
11372025-03-25T22:00:22.218ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
11382025-03-25T22:00:22.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
11392025-03-25T22:00:22.253ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
11402025-03-25T22:00:22.253ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
11412025-03-25T22:00:22.515ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "e08434dd-995c-424e-8ad2-4ae4a9c41627", "content-length": "31956", "date": "Tue, 25 Mar 2025 22:00:22 GMT"} })
11422025-03-25T22:00:22.516ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
11432025-03-25T22:00:22.516ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
11442025-03-25T22:00:22.516ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
11452025-03-25T22:00:22.518ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
11462025-03-25T22:00:22.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
11472025-03-25T22:00:22.520ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11482025-03-25T22:00:22.522ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
11492025-03-25T22:00:22.522ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
11502025-03-25T22:00:22.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
11512025-03-25T22:00:22.537ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
11522025-03-25T22:00:22.538ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
11532025-03-25T22:00:22.541ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
11542025-03-25T22:00:22.541ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
11552025-03-25T22:00:22.543ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11562025-03-25T22:00:22.546ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: c7210e4b-5a81-4ec8-b8fe-816a9508dc74, lookup_type: ById(c7210e4b-5a81-4ec8-b8fe-816a9508dc74) } result = Ok(())
11572025-03-25T22:00:22.546ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: c7210e4b-5a81-4ec8-b8fe-816a9508dc74, time_created: 2025-03-25T22:00:20.778316Z, time_modified: 2025-03-25T22:00:20.778316Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:770
11582025-03-25T22:00:22.574ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = eac53508-078d-4e05-aa88-5a3fdbd48e57 file = nexus/db-queries/src/db/datastore/inventory.rs:1010
11592025-03-25T22:00:22.574ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = eac53508-078d-4e05-aa88-5a3fdbd48e57 time_started = 2025-03-25 22:00:22.203088 UTC
11602025-03-25T22:00:22.574ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 3 reason = Dependency
11612025-03-25T22:00:22.574ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 430.392639ms iteration = 2 status = {"collection_id":"eac53508-078d-4e05-aa88-5a3fdbd48e57","time_done":"2025-03-25 22:00:22.516535 UTC","time_started":"2025-03-25 22:00:22.203088 UTC"}
11622025-03-25T22:00:22.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 3 reason = Dependency
11632025-03-25T22:00:22.574ZWARNnexus (BackgroundTasks): Blueprint rendezvous: skipped background_task = blueprint_rendezvous file = nexus/src/app/background/tasks/blueprint_rendezvous.rs:52 reason = no blueprint
11642025-03-25T22:00:22.574ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 5.81\u{b5}s iteration = 3 status = {"error":"no blueprint"}
11652025-03-25T22:00:22.574ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11662025-03-25T22:00:22.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11672025-03-25T22:00:22.576ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11682025-03-25T22:00:22.578ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
11692025-03-25T22:00:22.578ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11702025-03-25T22:00:22.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11712025-03-25T22:00:22.580ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:80 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
11722025-03-25T22:00:22.580ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 5.870622ms iteration = 3 status = {"error":"rack not yet initialized: c7210e4b-5a81-4ec8-b8fe-816a9508dc74"}
11732025-03-25T22:00:22.980ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:46409
11742025-03-25T22:00:22.982ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46409 req_id = 87af5647-cca4-4e82-bf12-8ee075522c7b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
11752025-03-25T22:00:22.982ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46409 req_id = 87af5647-cca4-4e82-bf12-8ee075522c7b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
11762025-03-25T22:00:23.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 29807 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46409 req_id = 87af5647-cca4-4e82-bf12-8ee075522c7b response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
11772025-03-25T22:00:23.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46409 req_id = 544cc284-6341-4144-8cf2-ba5c5c382fda roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
11782025-03-25T22:00:23.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46409 req_id = 544cc284-6341-4144-8cf2-ba5c5c382fda resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
11792025-03-25T22:00:23.053ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 34360 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46409 req_id = 544cc284-6341-4144-8cf2-ba5c5c382fda response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
11802025-03-25T22:00:23.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46409 req_id = ac18c2d0-4f30-4ed8-ba38-ad0ed4399089 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
11812025-03-25T22:00:23.053ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46409 req_id = ac18c2d0-4f30-4ed8-ba38-ad0ed4399089 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
11822025-03-25T22:00:23.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d8655e7f-0b16-4564-95b3-dcc812e2abf4 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
11832025-03-25T22:00:23.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d8655e7f-0b16-4564-95b3-dcc812e2abf4 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
11842025-03-25T22:00:23.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 19520 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46409 req_id = ac18c2d0-4f30-4ed8-ba38-ad0ed4399089 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
11852025-03-25T22:00:23.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46409 req_id = 7a53c939-c9e1-4bbb-8b7d-5e9e0c5a6903 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
11862025-03-25T22:00:23.074ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46409 req_id = 7a53c939-c9e1-4bbb-8b7d-5e9e0c5a6903 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
11872025-03-25T22:00:23.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 19225 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d8655e7f-0b16-4564-95b3-dcc812e2abf4 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
11882025-03-25T22:00:23.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 26687 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46409 req_id = 7a53c939-c9e1-4bbb-8b7d-5e9e0c5a6903 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
11892025-03-25T22:00:23.100ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46409 req_id = 1c78030c-fc13-47b0-88b0-85ba69a415b9 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
11902025-03-25T22:00:23.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46409 req_id = 1c78030c-fc13-47b0-88b0-85ba69a415b9 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
11912025-03-25T22:00:23.104ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4333 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46409 req_id = 1c78030c-fc13-47b0-88b0-85ba69a415b9 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
11922025-03-25T22:00:23.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46409 req_id = c8149b8f-4049-4022-a3e0-30027d17a387 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
11932025-03-25T22:00:23.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46409 req_id = c8149b8f-4049-4022-a3e0-30027d17a387 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
11942025-03-25T22:00:23.109ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4374 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46409 req_id = c8149b8f-4049-4022-a3e0-30027d17a387 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
11952025-03-25T22:00:23.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46409 req_id = 1032dc7a-20dc-4de3-817e-8c928a68fa6b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
11962025-03-25T22:00:23.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46409 req_id = 1032dc7a-20dc-4de3-817e-8c928a68fa6b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
11972025-03-25T22:00:23.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3152 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46409 req_id = 1032dc7a-20dc-4de3-817e-8c928a68fa6b response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
11982025-03-25T22:00:24.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 56406680-de43-4864-b0c5-1bcc2b30c5c5 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
11992025-03-25T22:00:24.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 56406680-de43-4864-b0c5-1bcc2b30c5c5 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
12002025-03-25T22:00:24.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2179 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 56406680-de43-4864-b0c5-1bcc2b30c5c5 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
12012025-03-25T22:00:24.547ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12022025-03-25T22:00:24.548ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12032025-03-25T22:00:24.549ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12042025-03-25T22:00:24.550ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12052025-03-25T22:00:24.553ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12062025-03-25T22:00:24.556ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: c7210e4b-5a81-4ec8-b8fe-816a9508dc74, lookup_type: ById(c7210e4b-5a81-4ec8-b8fe-816a9508dc74) } result = Ok(())
12072025-03-25T22:00:24.556ZINFOnexus: Rack initialized file = nexus/src/app/rack.rs:767
12082025-03-25T22:00:24.556ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12092025-03-25T22:00:24.556ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12102025-03-25T22:00:24.558ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12112025-03-25T22:00:24.558ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12122025-03-25T22:00:24.559ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12132025-03-25T22:00:24.560ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12142025-03-25T22:00:24.561ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12152025-03-25T22:00:24.561ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12162025-03-25T22:00:24.563ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12172025-03-25T22:00:24.563ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12182025-03-25T22:00:24.564ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12192025-03-25T22:00:24.564ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12202025-03-25T22:00:24.566ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12212025-03-25T22:00:24.569ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
12222025-03-25T22:00:24.569ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12232025-03-25T22:00:24.569ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12242025-03-25T22:00:24.570ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12252025-03-25T22:00:24.571ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12262025-03-25T22:00:24.572ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12272025-03-25T22:00:24.572ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12282025-03-25T22:00:24.574ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12292025-03-25T22:00:24.576ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
12302025-03-25T22:00:24.577ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12312025-03-25T22:00:24.577ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12322025-03-25T22:00:24.578ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12332025-03-25T22:00:24.578ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12342025-03-25T22:00:24.580ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12352025-03-25T22:00:24.580ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12362025-03-25T22:00:24.581ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12372025-03-25T22:00:24.581ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12382025-03-25T22:00:24.582ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12392025-03-25T22:00:24.583ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12402025-03-25T22:00:24.584ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12412025-03-25T22:00:24.584ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12422025-03-25T22:00:24.585ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12432025-03-25T22:00:24.585ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12442025-03-25T22:00:24.586ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12452025-03-25T22:00:24.589ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
12462025-03-25T22:00:24.589ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12472025-03-25T22:00:24.590ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12482025-03-25T22:00:24.591ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12492025-03-25T22:00:24.591ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12502025-03-25T22:00:24.592ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12512025-03-25T22:00:24.592ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12522025-03-25T22:00:24.594ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12532025-03-25T22:00:24.594ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12542025-03-25T22:00:24.595ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12552025-03-25T22:00:24.596ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12562025-03-25T22:00:24.597ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12572025-03-25T22:00:24.597ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12582025-03-25T22:00:24.598ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12592025-03-25T22:00:24.598ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12602025-03-25T22:00:24.600ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12612025-03-25T22:00:24.603ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
12622025-03-25T22:00:24.603ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12632025-03-25T22:00:24.603ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12642025-03-25T22:00:24.604ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12652025-03-25T22:00:24.604ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12662025-03-25T22:00:24.605ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12672025-03-25T22:00:24.605ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12682025-03-25T22:00:24.607ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12692025-03-25T22:00:24.610ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
12702025-03-25T22:00:24.610ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12712025-03-25T22:00:24.610ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12722025-03-25T22:00:24.614ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12732025-03-25T22:00:24.614ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12742025-03-25T22:00:24.616ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12752025-03-25T22:00:24.616ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12762025-03-25T22:00:24.617ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12772025-03-25T22:00:24.617ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12782025-03-25T22:00:24.619ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12792025-03-25T22:00:24.619ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12802025-03-25T22:00:24.621ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12812025-03-25T22:00:24.621ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12822025-03-25T22:00:24.622ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12832025-03-25T22:00:24.622ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12842025-03-25T22:00:24.624ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12852025-03-25T22:00:24.624ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12862025-03-25T22:00:24.625ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12872025-03-25T22:00:24.628ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
12882025-03-25T22:00:24.628ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12892025-03-25T22:00:24.628ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12902025-03-25T22:00:24.629ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12912025-03-25T22:00:24.629ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12922025-03-25T22:00:24.631ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12932025-03-25T22:00:24.631ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12942025-03-25T22:00:24.632ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12952025-03-25T22:00:24.635ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
12962025-03-25T22:00:24.635ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12972025-03-25T22:00:24.635ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12982025-03-25T22:00:24.641ZDEBGnexus (InternalApi): resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 29ce53a2-9f51-4baa-936c-a430afb38f28, kind: Service { id: d42076c6-06fe-4102-a978-c7d0a8dffb98 }, name: Name("external-dns-d42076c6-06fe-4102-a978-c7d0a8dffb98"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 55e2e815-bc90-43ee-bb61-e37b76792d5f, kind: Service { id: 58d382a7-99da-40a7-bc9f-2da7e9b156c1 }, name: Name("external-dns-58d382a7-99da-40a7-bc9f-2da7e9b156c1"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 30])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 12a41e9e-9631-4d38-b839-8dd2f1307510, kind: Service { id: f578ebd7-76c9-43f2-8d8c-99a164224c1c }, name: Name("nexus-f578ebd7-76c9-43f2-8d8c-99a164224c1c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 27c97441-bb9e-4408-b832-44b304dbd319, kind: Service { id: dc04dd71-e9ce-4d94-8637-d87f47eb7409 }, name: Name("nexus-dc04dd71-e9ce-4d94-8637-d87f47eb7409"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 244])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: de8b1653-42da-41b0-b524-fe87fd1390a1, kind: Service { id: 76a4636e-6952-47a1-8a71-cd6816e00858 }, name: Name("nexus-76a4636e-6952-47a1-8a71-cd6816e00858"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 87])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
12992025-03-25T22:00:24.641ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13002025-03-25T22:00:24.641ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13012025-03-25T22:00:24.642ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13022025-03-25T22:00:24.644ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet result = Ok(())
13032025-03-25T22:00:24.644ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13042025-03-25T22:00:24.644ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13052025-03-25T22:00:24.645ZDEBGnexus (InternalApi): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified.
13062025-03-25T22:00:24.648ZDEBGnexus (InternalApi): resolved firewall rules for sled agents sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 29ce53a2-9f51-4baa-936c-a430afb38f28, kind: Service { id: d42076c6-06fe-4102-a978-c7d0a8dffb98 }, name: Name("external-dns-d42076c6-06fe-4102-a978-c7d0a8dffb98"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 55e2e815-bc90-43ee-bb61-e37b76792d5f, kind: Service { id: 58d382a7-99da-40a7-bc9f-2da7e9b156c1 }, name: Name("external-dns-58d382a7-99da-40a7-bc9f-2da7e9b156c1"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 30])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 12a41e9e-9631-4d38-b839-8dd2f1307510, kind: Service { id: f578ebd7-76c9-43f2-8d8c-99a164224c1c }, name: Name("nexus-f578ebd7-76c9-43f2-8d8c-99a164224c1c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 27c97441-bb9e-4408-b832-44b304dbd319, kind: Service { id: dc04dd71-e9ce-4d94-8637-d87f47eb7409 }, name: Name("nexus-dc04dd71-e9ce-4d94-8637-d87f47eb7409"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 244])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: de8b1653-42da-41b0-b524-fe87fd1390a1, kind: Service { id: 76a4636e-6952-47a1-8a71-cd6816e00858 }, name: Name("nexus-76a4636e-6952-47a1-8a71-cd6816e00858"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 87])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
13072025-03-25T22:00:24.648ZDEBGnexus (InternalApi): resolved 2 rules for sleds
13082025-03-25T22:00:24.760ZDEBGnexus (InternalApi): resolved sleds for vpc oxide-services vpc_to_sled = [Sled { identity: SledIdentity { id: f034aaf6-2037-4cb4-8409-3ab31c15cc28, time_created: 2025-03-25T22:00:19.994158Z, time_modified: 2025-03-25T22:00:19.994158Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: c7210e4b-5a81-4ec8-b8fe-816a9508dc74, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)), repo_depot_port: SqlU16(12348) }]
13092025-03-25T22:00:24.761ZDEBGnexus (InternalApi): sending firewall rules to sled agents
13102025-03-25T22:00:24.761ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13112025-03-25T22:00:24.761ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13122025-03-25T22:00:24.763ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13132025-03-25T22:00:24.763ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13142025-03-25T22:00:24.765ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13152025-03-25T22:00:24.767ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Sled { parent: Fleet, key: f034aaf6-2037-4cb4-8409-3ab31c15cc28, lookup_type: ById(f034aaf6-2037-4cb4-8409-3ab31c15cc28) } result = Ok(())
13162025-03-25T22:00:24.798ZDEBGnexus (InternalApi): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
13172025-03-25T22:00:24.799ZDEBGnexus (InternalApi): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "737ff46d-672d-418a-b57d-1eceaf5e4a58", "date": "Tue, 25 Mar 2025 22:00:24 GMT"} })
13182025-03-25T22:00:24.800ZINFOnexus (InternalApi): updated firewall rules on 1 sleds file = nexus/networking/src/firewall_rules.rs:496
13192025-03-25T22:00:24.800ZINFOnexus: plumbed initial IP allowlist file = nexus/src/app/allow_list.rs:161
13202025-03-25T22:00:25.132ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e71e013d-d74d-43ed-b174-4740f017737e roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
13212025-03-25T22:00:25.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e71e013d-d74d-43ed-b174-4740f017737e resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
13222025-03-25T22:00:25.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1991 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e71e013d-d74d-43ed-b174-4740f017737e response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
13232025-03-25T22:00:26.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ebbabd11-89e4-46c8-9c39-3b2f5a604352 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
13242025-03-25T22:00:26.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ebbabd11-89e4-46c8-9c39-3b2f5a604352 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
13252025-03-25T22:00:26.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2149 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ebbabd11-89e4-46c8-9c39-3b2f5a604352 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
13262025-03-25T22:00:27.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f3e10234-0ced-4880-bffb-a87a2ef3ed74 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
13272025-03-25T22:00:27.176ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f3e10234-0ced-4880-bffb-a87a2ef3ed74 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
13282025-03-25T22:00:27.178ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2365 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f3e10234-0ced-4880-bffb-a87a2ef3ed74 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
13292025-03-25T22:00:28.119ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46409 req_id = a61492a1-6283-40f1-8d40-82226ab81a25 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
13302025-03-25T22:00:28.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46409 req_id = a61492a1-6283-40f1-8d40-82226ab81a25 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
13312025-03-25T22:00:28.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 17185 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46409 req_id = a61492a1-6283-40f1-8d40-82226ab81a25 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
13322025-03-25T22:00:28.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a255e8f3-3e0f-404f-b21d-58dbb948b5de roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
13332025-03-25T22:00:28.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a255e8f3-3e0f-404f-b21d-58dbb948b5de resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
13342025-03-25T22:00:28.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3148 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a255e8f3-3e0f-404f-b21d-58dbb948b5de response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
13352025-03-25T22:00:29.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b0240371-79b3-4dd7-a968-b01f025d7cc6 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
13362025-03-25T22:00:29.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b0240371-79b3-4dd7-a968-b01f025d7cc6 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
13372025-03-25T22:00:29.224ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1731 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b0240371-79b3-4dd7-a968-b01f025d7cc6 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
13382025-03-25T22:00:30.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 18396337-3b20-4213-aa22-f1ac1c2fd91b roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
13392025-03-25T22:00:30.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 18396337-3b20-4213-aa22-f1ac1c2fd91b resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
13402025-03-25T22:00:30.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2235 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 18396337-3b20-4213-aa22-f1ac1c2fd91b response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
13412025-03-25T22:00:30.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 2 reason = Timeout
13422025-03-25T22:00:30.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13432025-03-25T22:00:30.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13442025-03-25T22:00:30.843ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 2 reason = Timeout
13452025-03-25T22:00:30.843ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13462025-03-25T22:00:30.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13472025-03-25T22:00:30.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13482025-03-25T22:00:30.846ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13492025-03-25T22:00:30.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13502025-03-25T22:00:30.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13512025-03-25T22:00:30.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13522025-03-25T22:00:30.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13532025-03-25T22:00:30.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13542025-03-25T22:00:30.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13552025-03-25T22:00:30.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13562025-03-25T22:00:30.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
13572025-03-25T22:00:30.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13582025-03-25T22:00:30.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13592025-03-25T22:00:30.883ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 40.100601ms iteration = 2 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13602025-03-25T22:00:30.912ZINFOnexus (BackgroundTasks): found new target blueprint (first find) background_task = blueprint_loader file = nexus/src/app/background/tasks/blueprint_load.rs:88 target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
13612025-03-25T22:00:30.912ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 69.654347ms iteration = 2 status = {"enabled":false,"status":"first target blueprint","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z","time_found":"2025-03-25T22:00:30.912768809Z"}
13622025-03-25T22:00:30.912ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 2 reason = Dependency
13632025-03-25T22:00:30.912ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 2 reason = Dependency
13642025-03-25T22:00:30.912ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:82 reason = blueprint disabled target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7
13652025-03-25T22:00:30.912ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 17.801\u{b5}s iteration = 2 status = {"enabled":false,"target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7"}
13662025-03-25T22:00:30.912ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13672025-03-25T22:00:30.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13682025-03-25T22:00:30.913ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13692025-03-25T22:00:30.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13702025-03-25T22:00:30.913ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13712025-03-25T22:00:30.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13722025-03-25T22:00:30.913ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13732025-03-25T22:00:30.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13742025-03-25T22:00:30.913ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13752025-03-25T22:00:30.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13762025-03-25T22:00:30.915ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13772025-03-25T22:00:30.917ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
13782025-03-25T22:00:30.917ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13792025-03-25T22:00:30.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13802025-03-25T22:00:30.917ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13812025-03-25T22:00:30.919ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
13822025-03-25T22:00:30.919ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13832025-03-25T22:00:30.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13842025-03-25T22:00:30.919ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13852025-03-25T22:00:30.921ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
13862025-03-25T22:00:30.921ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13872025-03-25T22:00:30.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13882025-03-25T22:00:30.921ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13892025-03-25T22:00:30.923ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
13902025-03-25T22:00:30.923ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13912025-03-25T22:00:30.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13922025-03-25T22:00:30.923ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13932025-03-25T22:00:30.925ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
13942025-03-25T22:00:30.925ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13952025-03-25T22:00:30.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13962025-03-25T22:00:30.963ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::3]:32222/node/id
13972025-03-25T22:00:30.994ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::7]:32222/node/id
13982025-03-25T22:00:31.039ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::4]:32222/node/id
13992025-03-25T22:00:31.073ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::5]:32222/node/id
14002025-03-25T22:00:31.106ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::6]:32222/node/id
14012025-03-25T22:00:31.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1d676af7-ddc4-4146-b441-16c3de2a0862 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
14022025-03-25T22:00:31.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1d676af7-ddc4-4146-b441-16c3de2a0862 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
14032025-03-25T22:00:31.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2411 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1d676af7-ddc4-4146-b441-16c3de2a0862 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
14042025-03-25T22:00:31.961ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::4]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "09c6dc1d-0914-401b-aeac-1f175e2efea9", "content-length": "64", "date": "Tue, 25 Mar 2025 22:00:31 GMT"} })
14052025-03-25T22:00:31.961ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14062025-03-25T22:00:31.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14072025-03-25T22:00:31.982ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::7]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "178615d9-fb72-4d12-a890-b827c0ad9850", "content-length": "64", "date": "Tue, 25 Mar 2025 22:00:31 GMT"} })
14082025-03-25T22:00:31.982ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14092025-03-25T22:00:31.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14102025-03-25T22:00:31.984ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14112025-03-25T22:00:31.986ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
14122025-03-25T22:00:31.986ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14132025-03-25T22:00:31.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14142025-03-25T22:00:31.993ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14152025-03-25T22:00:31.995ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
14162025-03-25T22:00:31.995ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14172025-03-25T22:00:31.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14182025-03-25T22:00:32.024ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::6]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fdccf033-11f4-4797-8274-a4158c6b62dc", "content-length": "64", "date": "Tue, 25 Mar 2025 22:00:31 GMT"} })
14192025-03-25T22:00:32.024ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14202025-03-25T22:00:32.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14212025-03-25T22:00:32.031ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::3]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d039219e-2c56-45e0-8353-24bfd936d338", "content-length": "64", "date": "Tue, 25 Mar 2025 22:00:31 GMT"} })
14222025-03-25T22:00:32.031ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14232025-03-25T22:00:32.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14242025-03-25T22:00:32.033ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14252025-03-25T22:00:32.034ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
14262025-03-25T22:00:32.034ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14272025-03-25T22:00:32.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14282025-03-25T22:00:32.062ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14292025-03-25T22:00:32.063ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
14302025-03-25T22:00:32.063ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14312025-03-25T22:00:32.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14322025-03-25T22:00:32.063ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::5]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "342bcb62-5a29-4d97-9306-2227ee5312e3", "content-length": "64", "date": "Tue, 25 Mar 2025 22:00:32 GMT"} })
14332025-03-25T22:00:32.063ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14342025-03-25T22:00:32.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14352025-03-25T22:00:32.065ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14362025-03-25T22:00:32.066ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
14372025-03-25T22:00:32.066ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14382025-03-25T22:00:32.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14392025-03-25T22:00:32.075ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 1.162981625s iteration = 2 status = {"nsuccess":5}
14402025-03-25T22:00:32.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 86208059-19b1-49b9-a815-f05725b60361 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
14412025-03-25T22:00:32.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 86208059-19b1-49b9-a815-f05725b60361 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
14422025-03-25T22:00:32.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1962 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 86208059-19b1-49b9-a815-f05725b60361 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
14432025-03-25T22:00:33.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 37115599-dc63-4304-8532-aab9757c2845 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
14442025-03-25T22:00:33.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 37115599-dc63-4304-8532-aab9757c2845 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
14452025-03-25T22:00:33.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2627 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 37115599-dc63-4304-8532-aab9757c2845 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
14462025-03-25T22:00:34.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2e1a64b9-3185-458c-b9d3-cd25a4de1ea6 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
14472025-03-25T22:00:34.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2e1a64b9-3185-458c-b9d3-cd25a4de1ea6 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
14482025-03-25T22:00:34.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2518 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2e1a64b9-3185-458c-b9d3-cd25a4de1ea6 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
14492025-03-25T22:00:35.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0173aed9-3860-4203-9467-7614cb0336b4 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
14502025-03-25T22:00:35.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0173aed9-3860-4203-9467-7614cb0336b4 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
14512025-03-25T22:00:35.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1627 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0173aed9-3860-4203-9467-7614cb0336b4 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
14522025-03-25T22:00:36.379ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0d51da19-15a1-45ab-8c24-3e2c981a1208 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
14532025-03-25T22:00:36.379ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0d51da19-15a1-45ab-8c24-3e2c981a1208 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
14542025-03-25T22:00:36.381ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2148 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0d51da19-15a1-45ab-8c24-3e2c981a1208 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
14552025-03-25T22:00:37.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 679e8297-9e91-4186-93bb-8aed64f56831 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
14562025-03-25T22:00:37.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 679e8297-9e91-4186-93bb-8aed64f56831 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
14572025-03-25T22:00:37.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2249 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 679e8297-9e91-4186-93bb-8aed64f56831 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
14582025-03-25T22:00:38.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5c2f4dbd-3ed9-4dca-bc0f-e4edb941b2cd roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
14592025-03-25T22:00:38.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5c2f4dbd-3ed9-4dca-bc0f-e4edb941b2cd resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
14602025-03-25T22:00:38.424ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1677 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5c2f4dbd-3ed9-4dca-bc0f-e4edb941b2cd response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
14612025-03-25T22:00:39.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f2893b47-8312-4b7f-ba1e-b239995c1043 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
14622025-03-25T22:00:39.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f2893b47-8312-4b7f-ba1e-b239995c1043 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
14632025-03-25T22:00:39.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2242 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f2893b47-8312-4b7f-ba1e-b239995c1043 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
14642025-03-25T22:00:40.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a5917914-a8f3-446d-adec-3c822a4c32b8 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
14652025-03-25T22:00:40.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a5917914-a8f3-446d-adec-3c822a4c32b8 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
14662025-03-25T22:00:40.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2061 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a5917914-a8f3-446d-adec-3c822a4c32b8 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
14672025-03-25T22:00:40.842ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 3 reason = Timeout
14682025-03-25T22:00:40.842ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14692025-03-25T22:00:40.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14702025-03-25T22:00:40.843ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 3 reason = Timeout
14712025-03-25T22:00:40.843ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14722025-03-25T22:00:40.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14732025-03-25T22:00:40.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14742025-03-25T22:00:40.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14752025-03-25T22:00:40.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14762025-03-25T22:00:40.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14772025-03-25T22:00:40.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14782025-03-25T22:00:40.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14792025-03-25T22:00:40.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14802025-03-25T22:00:40.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
14812025-03-25T22:00:40.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14822025-03-25T22:00:40.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14832025-03-25T22:00:40.861ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
14842025-03-25T22:00:40.861ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.485103ms iteration = 3 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
14852025-03-25T22:00:40.871ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14862025-03-25T22:00:40.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14872025-03-25T22:00:40.907ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.275735ms iteration = 3 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14882025-03-25T22:00:41.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 46afa1b8-5b4b-4fe9-9c04-c4fc965fea72 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
14892025-03-25T22:00:41.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 46afa1b8-5b4b-4fe9-9c04-c4fc965fea72 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
14902025-03-25T22:00:41.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2061 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 46afa1b8-5b4b-4fe9-9c04-c4fc965fea72 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
14912025-03-25T22:00:42.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2a81e69a-6376-46ff-b6e5-1a2312b96330 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
14922025-03-25T22:00:42.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2a81e69a-6376-46ff-b6e5-1a2312b96330 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
14932025-03-25T22:00:42.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1743 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2a81e69a-6376-46ff-b6e5-1a2312b96330 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
14942025-03-25T22:00:43.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5b4465d1-4215-4c82-99f0-ebf6f8962585 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
14952025-03-25T22:00:43.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5b4465d1-4215-4c82-99f0-ebf6f8962585 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
14962025-03-25T22:00:43.531ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2823 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5b4465d1-4215-4c82-99f0-ebf6f8962585 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
14972025-03-25T22:00:43.564ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:46211
14982025-03-25T22:00:43.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46211 req_id = ec10c771-c470-4736-ad36-a9d010a953e9 roles = RoleSet { roles: {} } uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
14992025-03-25T22:00:43.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46211 req_id = ec10c771-c470-4736-ad36-a9d010a953e9 resource = Database result = Ok(()) uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
15002025-03-25T22:00:43.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3428 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46211 req_id = ec10c771-c470-4736-ad36-a9d010a953e9 response_code = 200 uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
15012025-03-25T22:00:43.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46211 req_id = 229db19e-db51-4e46-840d-238753f63983 roles = RoleSet { roles: {} } uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDM0YWFmNi0yMDM3LTRjYjQtODQwOS0zYWIzMWMxNWNjMjgifX0%3D
15022025-03-25T22:00:43.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46211 req_id = 229db19e-db51-4e46-840d-238753f63983 resource = Database result = Ok(()) uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDM0YWFmNi0yMDM3LTRjYjQtODQwOS0zYWIzMWMxNWNjMjgifX0%3D
15032025-03-25T22:00:43.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4584 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46211 req_id = 229db19e-db51-4e46-840d-238753f63983 response_code = 200 uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDM0YWFmNi0yMDM3LTRjYjQtODQwOS0zYWIzMWMxNWNjMjgifX0%3D
15042025-03-25T22:00:44.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6019452b-8330-4388-bac2-11eaf92ac300 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
15052025-03-25T22:00:44.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6019452b-8330-4388-bac2-11eaf92ac300 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
15062025-03-25T22:00:44.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2215 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6019452b-8330-4388-bac2-11eaf92ac300 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
15072025-03-25T22:00:45.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2b91a55c-091d-4a5c-b426-9dd45d15ecb1 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
15082025-03-25T22:00:45.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2b91a55c-091d-4a5c-b426-9dd45d15ecb1 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
15092025-03-25T22:00:45.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1661 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2b91a55c-091d-4a5c-b426-9dd45d15ecb1 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
15102025-03-25T22:00:46.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5de6f55e-0f5f-452b-8424-ba1d71055894 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
15112025-03-25T22:00:46.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5de6f55e-0f5f-452b-8424-ba1d71055894 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
15122025-03-25T22:00:46.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2464 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5de6f55e-0f5f-452b-8424-ba1d71055894 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
15132025-03-25T22:00:47.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5551a89e-2e81-4ef2-b40a-066785012f0e roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
15142025-03-25T22:00:47.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5551a89e-2e81-4ef2-b40a-066785012f0e resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
15152025-03-25T22:00:47.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2423 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5551a89e-2e81-4ef2-b40a-066785012f0e response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
15162025-03-25T22:00:48.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 57f98d15-f711-484a-9798-10354abe29e3 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
15172025-03-25T22:00:48.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 57f98d15-f711-484a-9798-10354abe29e3 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
15182025-03-25T22:00:48.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2996 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 57f98d15-f711-484a-9798-10354abe29e3 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
15192025-03-25T22:00:49.657ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 660b42e4-2769-40b0-a049-244f3de47697 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
15202025-03-25T22:00:49.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 660b42e4-2769-40b0-a049-244f3de47697 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
15212025-03-25T22:00:49.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2004 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 660b42e4-2769-40b0-a049-244f3de47697 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
15222025-03-25T22:00:50.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6388cffd-d26f-49aa-9d7a-18ce6b7e1674 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
15232025-03-25T22:00:50.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6388cffd-d26f-49aa-9d7a-18ce6b7e1674 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
15242025-03-25T22:00:50.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1981 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6388cffd-d26f-49aa-9d7a-18ce6b7e1674 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
15252025-03-25T22:00:50.842ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 2 reason = Timeout
15262025-03-25T22:00:50.842ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 2 reason = Timeout
15272025-03-25T22:00:50.842ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
15282025-03-25T22:00:50.842ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 2 reason = Timeout
15292025-03-25T22:00:50.842ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 4 reason = Timeout
15302025-03-25T22:00:50.842ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15312025-03-25T22:00:50.842ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 2 reason = Timeout
15322025-03-25T22:00:50.842ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15332025-03-25T22:00:50.842ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
15342025-03-25T22:00:50.842ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 4 reason = Timeout
15352025-03-25T22:00:50.842ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15362025-03-25T22:00:50.842ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 2 reason = Timeout
15372025-03-25T22:00:50.842ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15382025-03-25T22:00:50.842ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 2 reason = Timeout
15392025-03-25T22:00:50.842ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15402025-03-25T22:00:50.842ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 2 reason = Timeout
15412025-03-25T22:00:50.842ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
15422025-03-25T22:00:50.842ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 2 reason = Timeout
15432025-03-25T22:00:50.842ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
15442025-03-25T22:00:50.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15452025-03-25T22:00:50.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
15462025-03-25T22:00:50.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
15472025-03-25T22:00:50.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15482025-03-25T22:00:50.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15492025-03-25T22:00:50.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
15502025-03-25T22:00:50.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15512025-03-25T22:00:50.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15522025-03-25T22:00:50.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
15532025-03-25T22:00:50.843ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 4 reason = Timeout
15542025-03-25T22:00:50.843ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 2 reason = Timeout
15552025-03-25T22:00:50.843ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15562025-03-25T22:00:50.843ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
15572025-03-25T22:00:50.843ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 2 reason = Timeout
15582025-03-25T22:00:50.844ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
15592025-03-25T22:00:50.844ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 2 reason = Timeout
15602025-03-25T22:00:50.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
15612025-03-25T22:00:50.844ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 2 reason = Timeout
15622025-03-25T22:00:50.844ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
15632025-03-25T22:00:50.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15642025-03-25T22:00:50.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 2 reason = Timeout
15652025-03-25T22:00:50.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
15662025-03-25T22:00:50.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 2 reason = Timeout
15672025-03-25T22:00:50.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
15682025-03-25T22:00:50.844ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 2 reason = Timeout
15692025-03-25T22:00:50.844ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
15702025-03-25T22:00:50.844ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15712025-03-25T22:00:50.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 2 reason = Timeout
15722025-03-25T22:00:50.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
15732025-03-25T22:00:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
15742025-03-25T22:00:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
15752025-03-25T22:00:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
15762025-03-25T22:00:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15772025-03-25T22:00:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
15782025-03-25T22:00:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15792025-03-25T22:00:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
15802025-03-25T22:00:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15812025-03-25T22:00:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
15822025-03-25T22:00:50.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15832025-03-25T22:00:50.845ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15842025-03-25T22:00:50.845ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15852025-03-25T22:00:50.847ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.636791ms iteration = 2 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
15862025-03-25T22:00:50.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15872025-03-25T22:00:50.847ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15882025-03-25T22:00:50.847ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6204, tv_nsec: 184442500 } })
15892025-03-25T22:00:50.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
15902025-03-25T22:00:50.847ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
15912025-03-25T22:00:50.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15922025-03-25T22:00:50.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
15932025-03-25T22:00:50.848ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1171
15942025-03-25T22:00:50.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15952025-03-25T22:00:50.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15962025-03-25T22:00:50.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15972025-03-25T22:00:50.849ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
15982025-03-25T22:00:50.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
15992025-03-25T22:00:50.851ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16002025-03-25T22:00:50.853ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16012025-03-25T22:00:50.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
16022025-03-25T22:00:50.853ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
16032025-03-25T22:00:50.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
16042025-03-25T22:00:50.855ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
16052025-03-25T22:00:50.855ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16062025-03-25T22:00:50.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16072025-03-25T22:00:50.856ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16082025-03-25T22:00:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16092025-03-25T22:00:50.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16102025-03-25T22:00:50.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16112025-03-25T22:00:50.868ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16122025-03-25T22:00:50.871ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
16132025-03-25T22:00:50.871ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16142025-03-25T22:00:50.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16152025-03-25T22:00:50.871ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6204, tv_nsec: 208479680 } })
16162025-03-25T22:00:50.872ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1171
16172025-03-25T22:00:50.903ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16182025-03-25T22:00:50.903ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
16192025-03-25T22:00:50.903ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16202025-03-25T22:00:50.905ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "68a85973-29c3-4b96-8d1f-1579630326f0", "content-length": "26", "date": "Tue, 25 Mar 2025 22:00:50 GMT"} })
16212025-03-25T22:00:50.905ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16222025-03-25T22:00:50.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
16232025-03-25T22:00:50.906ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16242025-03-25T22:00:50.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16252025-03-25T22:00:50.907ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16262025-03-25T22:00:50.911ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
16272025-03-25T22:00:50.911ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
16282025-03-25T22:00:50.911ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
16292025-03-25T22:00:50.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
16302025-03-25T22:00:50.914ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16312025-03-25T22:00:50.914ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 70.351629ms iteration = 2 status = {"errors":[],"garbage_collect_requested":[]}
16322025-03-25T22:00:50.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16332025-03-25T22:00:50.919ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16342025-03-25T22:00:50.919ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16352025-03-25T22:00:50.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16362025-03-25T22:00:50.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16372025-03-25T22:00:50.921ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 77.480223ms iteration = 2 status = {"errors":[],"requests_created_ok":[]}
16382025-03-25T22:00:50.924ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 80.690149ms iteration = 2 status = {"errors":[],"finish_invoked_ok":[]}
16392025-03-25T22:00:50.926ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16402025-03-25T22:00:50.932ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 89.840039ms iteration = 2 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
16412025-03-25T22:00:50.933ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16422025-03-25T22:00:50.933ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
16432025-03-25T22:00:50.933ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16442025-03-25T22:00:50.933ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16452025-03-25T22:00:50.933ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
16462025-03-25T22:00:50.933ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 89.612176ms iteration = 2 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
16472025-03-25T22:00:50.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16482025-03-25T22:00:50.936ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
16492025-03-25T22:00:50.936ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16502025-03-25T22:00:50.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16512025-03-25T22:00:50.936ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6204, tv_nsec: 273666409 } })
16522025-03-25T22:00:50.937ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1171 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
16532025-03-25T22:00:50.937ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
16542025-03-25T22:00:50.937ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16552025-03-25T22:00:50.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16562025-03-25T22:00:50.942ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
16572025-03-25T22:00:50.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
16582025-03-25T22:00:50.944ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16592025-03-25T22:00:50.946ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
16602025-03-25T22:00:50.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
16612025-03-25T22:00:50.947ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
16622025-03-25T22:00:50.947ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
16632025-03-25T22:00:50.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
16642025-03-25T22:00:50.948ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
16652025-03-25T22:00:50.948ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 106.4774ms iteration = 4 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
16662025-03-25T22:00:50.963ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
16672025-03-25T22:00:50.963ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16682025-03-25T22:00:50.964ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f4ff9460-593c-47bd-aae9-779f001a616f", "content-length": "26", "date": "Tue, 25 Mar 2025 22:00:50 GMT"} })
16692025-03-25T22:00:50.964ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16702025-03-25T22:00:50.966ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16712025-03-25T22:00:50.973ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16722025-03-25T22:00:50.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16732025-03-25T22:00:50.975ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
16742025-03-25T22:00:50.975ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
16752025-03-25T22:00:50.975ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
16762025-03-25T22:00:50.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
16772025-03-25T22:00:50.980ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16782025-03-25T22:00:50.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16792025-03-25T22:00:50.981ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 137.819337ms iteration = 4 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16802025-03-25T22:00:50.983ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
16812025-03-25T22:00:50.983ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "0bfe538b-2cd8-4a20-972d-790e828c013b", "content-length": "1", "date": "Tue, 25 Mar 2025 22:00:50 GMT"} })
16822025-03-25T22:00:50.985ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16832025-03-25T22:00:50.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16842025-03-25T22:00:50.988ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 146.207844ms iteration = 2 status = null
16852025-03-25T22:00:50.993ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16862025-03-25T22:00:50.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16872025-03-25T22:00:50.997ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 153.917039ms iteration = 2 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
16882025-03-25T22:00:51.002ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 zone_address = fd00:1122:3344:101::2
16892025-03-25T22:00:51.002ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16902025-03-25T22:00:51.002ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:360
16912025-03-25T22:00:51.002ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 160.340541ms iteration = 2 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
16922025-03-25T22:00:51.003ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f20a3d2-63ef-45bd-9692-62862795505a", "content-length": "26", "date": "Tue, 25 Mar 2025 22:00:50 GMT"} })
16932025-03-25T22:00:51.003ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1184 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16942025-03-25T22:00:51.004ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
16952025-03-25T22:00:51.005ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 161.920369ms iteration = 2 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
16962025-03-25T22:00:51.017ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16972025-03-25T22:00:51.018ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 175.892353ms iteration = 2 status = {}
16982025-03-25T22:00:51.020ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f034aaf6-2037-4cb4-8409-3ab31c15cc28, lookup_type: ById(f034aaf6-2037-4cb4-8409-3ab31c15cc28) } result = Ok(())
16992025-03-25T22:00:51.020ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17002025-03-25T22:00:51.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17012025-03-25T22:00:51.023ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17022025-03-25T22:00:51.023ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
17032025-03-25T22:00:51.023ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 179.017678ms iteration = 2 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
17042025-03-25T22:00:51.023ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17052025-03-25T22:00:51.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17062025-03-25T22:00:51.023ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17072025-03-25T22:00:51.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17082025-03-25T22:00:51.029ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 187.005657ms iteration = 4 status = {"physical_disks_added":0}
17092025-03-25T22:00:51.034ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17102025-03-25T22:00:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17112025-03-25T22:00:51.050ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17122025-03-25T22:00:51.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17132025-03-25T22:00:51.060ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17142025-03-25T22:00:51.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17152025-03-25T22:00:51.076ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6204, tv_nsec: 413620234 } })
17162025-03-25T22:00:51.077ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1171
17172025-03-25T22:00:51.120ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
17182025-03-25T22:00:51.120ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
17192025-03-25T22:00:51.121ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e5ef5388-aa89-4183-a614-41e013a19b02", "content-length": "372", "date": "Tue, 25 Mar 2025 22:00:51 GMT"} })
17202025-03-25T22:00:51.121ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17212025-03-25T22:00:51.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17222025-03-25T22:00:51.144ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
17232025-03-25T22:00:51.144ZDEBGnexus (MgsClient): client request background_task = service_zone_nat_tracker body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17242025-03-25T22:00:51.145ZDEBGnexus (MgsClient): client response background_task = service_zone_nat_tracker result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1de95d6c-6312-4891-8683-b20d65e1a948", "content-length": "26", "date": "Tue, 25 Mar 2025 22:00:50 GMT"} })
17252025-03-25T22:00:51.145ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17262025-03-25T22:00:51.146ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
17272025-03-25T22:00:51.146ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
17282025-03-25T22:00:51.146ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
17292025-03-25T22:00:51.146ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "cad7c236-9058-4489-bc44-6b80994d8007", "date": "Tue, 25 Mar 2025 22:00:51 GMT"} })
17302025-03-25T22:00:51.146ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17312025-03-25T22:00:51.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17322025-03-25T22:00:51.149ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17332025-03-25T22:00:51.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17342025-03-25T22:00:51.154ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17352025-03-25T22:00:51.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17362025-03-25T22:00:51.158ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
17372025-03-25T22:00:51.158ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
17382025-03-25T22:00:51.159ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8e9822f3-e233-4eaf-bb98-1682f07b7c56", "date": "Tue, 25 Mar 2025 22:00:51 GMT"} })
17392025-03-25T22:00:51.160ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 316.941066ms iteration = 2 status = {}
17402025-03-25T22:00:51.174ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17412025-03-25T22:00:51.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17422025-03-25T22:00:51.176ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17432025-03-25T22:00:51.178ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
17442025-03-25T22:00:51.178ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17452025-03-25T22:00:51.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17462025-03-25T22:00:51.179ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17472025-03-25T22:00:51.181ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
17482025-03-25T22:00:51.181ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17492025-03-25T22:00:51.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17502025-03-25T22:00:51.197ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17512025-03-25T22:00:51.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17522025-03-25T22:00:51.199ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a5db250-fa3f-4168-ab16-5c36568c22e2, rack_id: c7210e4b-5a81-4ec8-b8fe-816a9508dc74, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(6d5dda50-e3c4-4853-9bfa-a66b447ab351) } rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
17532025-03-25T22:00:51.199ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17542025-03-25T22:00:51.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17552025-03-25T22:00:51.206ZDEBGnexus (DpdClient): client request background_task = service_zone_nat_tracker body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
17562025-03-25T22:00:51.208ZDEBGnexus (DpdClient): client response background_task = service_zone_nat_tracker result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "c20c68c3-4e46-4b9c-8a40-1f554b88e1db", "content-length": "4", "date": "Tue, 25 Mar 2025 22:00:50 GMT"} })
17572025-03-25T22:00:51.209ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 366.878529ms iteration = 2 status = 4
17582025-03-25T22:00:51.224ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
17592025-03-25T22:00:51.225ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c27fe77d-f682-4340-8244-f6a4c0d9a02b", "content-length": "691", "date": "Tue, 25 Mar 2025 22:00:51 GMT"} })
17602025-03-25T22:00:51.225ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
17612025-03-25T22:00:51.225ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
17622025-03-25T22:00:51.225ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
17632025-03-25T22:00:51.227ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 384.526297ms iteration = 2 status = {}
17642025-03-25T22:00:51.278ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
17652025-03-25T22:00:51.279ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "f013d7f3-fc13-4539-8a30-fd269a9abb70", "content-length": "134", "date": "Tue, 25 Mar 2025 22:00:50 GMT"} })
17662025-03-25T22:00:51.279ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
17672025-03-25T22:00:51.279ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 6d5dda50-e3c4-4853-9bfa-a66b447ab351
17682025-03-25T22:00:51.283ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
17692025-03-25T22:00:51.283ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
17702025-03-25T22:00:51.283ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17712025-03-25T22:00:51.283ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17722025-03-25T22:00:51.283ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17732025-03-25T22:00:51.283ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
17742025-03-25T22:00:51.286ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17752025-03-25T22:00:51.287ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
17762025-03-25T22:00:51.287ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
17772025-03-25T22:00:51.287ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17782025-03-25T22:00:51.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17792025-03-25T22:00:51.298ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
17802025-03-25T22:00:51.298ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7538b83d-4098-4db0-8035-44a454c2f115", "content-length": "2", "date": "Tue, 25 Mar 2025 22:00:51 GMT"} })
17812025-03-25T22:00:51.298ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
17822025-03-25T22:00:51.298ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b70afba-f79c-4587-b3df-b3b9ad376346", "content-length": "52", "date": "Tue, 25 Mar 2025 22:00:51 GMT"} })
17832025-03-25T22:00:51.298ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
17842025-03-25T22:00:51.298ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
17852025-03-25T22:00:51.452ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8abdf191-59bd-47f2-8e74-2d27bf955d8f", "date": "Tue, 25 Mar 2025 22:00:51 GMT"} })
17862025-03-25T22:00:51.452ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch = Switch0
17872025-03-25T22:00:51.452ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
17882025-03-25T22:00:51.457ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "40e8eebc-17f2-459b-bb2f-99c4bc15ba34", "content-length": "539", "date": "Tue, 25 Mar 2025 22:00:51 GMT"} })
17892025-03-25T22:00:51.457ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17902025-03-25T22:00:51.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17912025-03-25T22:00:51.469ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17922025-03-25T22:00:51.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17932025-03-25T22:00:51.473ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17942025-03-25T22:00:51.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17952025-03-25T22:00:51.475ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17962025-03-25T22:00:51.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17972025-03-25T22:00:51.483ZWARNnexus (BackgroundTasks): no bootstore config found in db background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1229 key = network_key rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
17982025-03-25T22:00:51.483ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17992025-03-25T22:00:51.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18002025-03-25T22:00:51.495ZINFOnexus (BackgroundTasks): updating bootstore config background_task = switch_port_config_manager config = EarlyNetworkConfig { body: EarlyNetworkConfigBody { ntp_servers: ["0.pool.ntp.org"], rack_network_config: Some(RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], autoneg: false, bgp_peers: [], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None }], switch: Switch0, tx_eq: None, uplink_port_fec: Some(None), uplink_port_speed: Speed40G }], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 } }) }, generation: 2, schema_version: 2 } file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1286 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
18012025-03-25T22:00:51.495ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = PUT rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
18022025-03-25T22:00:51.502ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 204, headers: {"x-request-id": "5fb60869-0a9f-41bf-917a-c7646d5cd459", "date": "Tue, 25 Mar 2025 22:00:51 GMT"} })
18032025-03-25T22:00:51.503ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18042025-03-25T22:00:51.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18052025-03-25T22:00:51.513ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 671.078773ms iteration = 2 status = {}
18062025-03-25T22:00:51.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ff9620e5-4346-4406-993d-88c70d2952f0 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18072025-03-25T22:00:51.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ff9620e5-4346-4406-993d-88c70d2952f0 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18082025-03-25T22:00:51.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1715 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ff9620e5-4346-4406-993d-88c70d2952f0 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18092025-03-25T22:00:52.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46409 req_id = f9fa7aff-ac04-4a84-82c4-b78834024736 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
18102025-03-25T22:00:52.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46409 req_id = f9fa7aff-ac04-4a84-82c4-b78834024736 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
18112025-03-25T22:00:52.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4575 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46409 req_id = f9fa7aff-ac04-4a84-82c4-b78834024736 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
18122025-03-25T22:00:52.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46409 req_id = 06f755ab-4ddf-42ab-a332-5bc9297e551e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
18132025-03-25T22:00:52.167ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46409 req_id = 06f755ab-4ddf-42ab-a332-5bc9297e551e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
18142025-03-25T22:00:52.170ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3269 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46409 req_id = 06f755ab-4ddf-42ab-a332-5bc9297e551e response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
18152025-03-25T22:00:52.719ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e56a8b88-2ac1-430d-87f8-ee18e6445d51 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18162025-03-25T22:00:52.720ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e56a8b88-2ac1-430d-87f8-ee18e6445d51 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18172025-03-25T22:00:52.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2231 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e56a8b88-2ac1-430d-87f8-ee18e6445d51 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18182025-03-25T22:00:53.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 26b7a910-dd01-4339-990e-c2a79cbe8113 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18192025-03-25T22:00:53.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 26b7a910-dd01-4339-990e-c2a79cbe8113 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18202025-03-25T22:00:53.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1612 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 26b7a910-dd01-4339-990e-c2a79cbe8113 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18212025-03-25T22:00:54.762ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3966c66a-f26b-43bd-9bfa-339442245bdb roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18222025-03-25T22:00:54.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3966c66a-f26b-43bd-9bfa-339442245bdb resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18232025-03-25T22:00:54.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2210 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3966c66a-f26b-43bd-9bfa-339442245bdb response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18242025-03-25T22:00:55.786ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 973cd59f-8e57-459f-ba8c-c5507ef85c09 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18252025-03-25T22:00:55.786ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 973cd59f-8e57-459f-ba8c-c5507ef85c09 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18262025-03-25T22:00:55.788ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2293 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 973cd59f-8e57-459f-ba8c-c5507ef85c09 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18272025-03-25T22:00:56.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 352ceb1d-a449-4fe1-b013-44436d5ee15c roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18282025-03-25T22:00:56.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 352ceb1d-a449-4fe1-b013-44436d5ee15c resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18292025-03-25T22:00:56.810ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2161 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 352ceb1d-a449-4fe1-b013-44436d5ee15c response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18302025-03-25T22:00:57.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5791f9ee-fe79-429f-b41d-ec0ed63c6b7b roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18312025-03-25T22:00:57.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5791f9ee-fe79-429f-b41d-ec0ed63c6b7b resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18322025-03-25T22:00:57.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1994 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5791f9ee-fe79-429f-b41d-ec0ed63c6b7b response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18332025-03-25T22:00:58.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ef45b4f1-e6f1-4393-98f7-e96f9ca4baf1 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18342025-03-25T22:00:58.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ef45b4f1-e6f1-4393-98f7-e96f9ca4baf1 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18352025-03-25T22:00:58.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2180 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ef45b4f1-e6f1-4393-98f7-e96f9ca4baf1 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18362025-03-25T22:00:59.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5be7814c-56d6-4c89-b19c-84c330f943a0 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18372025-03-25T22:00:59.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5be7814c-56d6-4c89-b19c-84c330f943a0 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18382025-03-25T22:00:59.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2542 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5be7814c-56d6-4c89-b19c-84c330f943a0 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18392025-03-25T22:01:00.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 5 reason = Timeout
18402025-03-25T22:01:00.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18412025-03-25T22:01:00.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18422025-03-25T22:01:00.843ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 5 reason = Timeout
18432025-03-25T22:01:00.843ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18442025-03-25T22:01:00.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18452025-03-25T22:01:00.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18462025-03-25T22:01:00.845ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18472025-03-25T22:01:00.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18482025-03-25T22:01:00.847ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.993209ms iteration = 5 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18492025-03-25T22:01:00.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18502025-03-25T22:01:00.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18512025-03-25T22:01:00.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18522025-03-25T22:01:00.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18532025-03-25T22:01:00.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18542025-03-25T22:01:00.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18552025-03-25T22:01:00.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
18562025-03-25T22:01:00.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18572025-03-25T22:01:00.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18582025-03-25T22:01:00.859ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
18592025-03-25T22:01:00.859ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.60333ms iteration = 5 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
18602025-03-25T22:01:00.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f7337f08-8083-4246-b3ce-c3106c8af545 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18612025-03-25T22:01:00.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f7337f08-8083-4246-b3ce-c3106c8af545 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18622025-03-25T22:01:00.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1937 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f7337f08-8083-4246-b3ce-c3106c8af545 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18632025-03-25T22:01:01.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2aabb66d-b208-4a6e-a5cd-55d968bc09f0 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18642025-03-25T22:01:01.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2aabb66d-b208-4a6e-a5cd-55d968bc09f0 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18652025-03-25T22:01:01.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2264 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2aabb66d-b208-4a6e-a5cd-55d968bc09f0 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18662025-03-25T22:01:02.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1c1a8477-defe-4771-8771-15d897fe4aeb roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18672025-03-25T22:01:02.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1c1a8477-defe-4771-8771-15d897fe4aeb resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18682025-03-25T22:01:02.941ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1662 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1c1a8477-defe-4771-8771-15d897fe4aeb response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18692025-03-25T22:01:03.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = bae948df-cf0f-4579-b742-9ffbac194b27 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18702025-03-25T22:01:03.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = bae948df-cf0f-4579-b742-9ffbac194b27 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18712025-03-25T22:01:03.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1697 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = bae948df-cf0f-4579-b742-9ffbac194b27 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18722025-03-25T22:01:04.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3b5ccb22-3885-4e4f-813a-f59c09dbee61 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18732025-03-25T22:01:04.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3b5ccb22-3885-4e4f-813a-f59c09dbee61 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18742025-03-25T22:01:04.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2394 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3b5ccb22-3885-4e4f-813a-f59c09dbee61 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18752025-03-25T22:01:06.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7a844ef5-7f8c-4bb1-a31f-0dc64ac2573e roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18762025-03-25T22:01:06.007ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7a844ef5-7f8c-4bb1-a31f-0dc64ac2573e resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18772025-03-25T22:01:06.009ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2645 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7a844ef5-7f8c-4bb1-a31f-0dc64ac2573e response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18782025-03-25T22:01:07.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = fb2e4777-5330-4fdf-bd86-d3ff73670946 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18792025-03-25T22:01:07.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = fb2e4777-5330-4fdf-bd86-d3ff73670946 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18802025-03-25T22:01:07.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2894 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = fb2e4777-5330-4fdf-bd86-d3ff73670946 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18812025-03-25T22:01:08.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ba6157ba-d05a-4a25-97c1-267ae05ddaea roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18822025-03-25T22:01:08.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ba6157ba-d05a-4a25-97c1-267ae05ddaea resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18832025-03-25T22:01:08.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2283 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ba6157ba-d05a-4a25-97c1-267ae05ddaea response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18842025-03-25T22:01:09.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e12e7ee0-4cd1-48f4-b968-907deb7da7e3 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18852025-03-25T22:01:09.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e12e7ee0-4cd1-48f4-b968-907deb7da7e3 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18862025-03-25T22:01:09.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2601 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e12e7ee0-4cd1-48f4-b968-907deb7da7e3 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18872025-03-25T22:01:10.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b059c30e-ce1a-451f-b938-32054c91c8ea roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18882025-03-25T22:01:10.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b059c30e-ce1a-451f-b938-32054c91c8ea resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18892025-03-25T22:01:10.097ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2671 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b059c30e-ce1a-451f-b938-32054c91c8ea response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
18902025-03-25T22:01:10.842ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 6 reason = Timeout
18912025-03-25T22:01:10.842ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18922025-03-25T22:01:10.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18932025-03-25T22:01:10.843ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 6 reason = Timeout
18942025-03-25T22:01:10.843ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18952025-03-25T22:01:10.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18962025-03-25T22:01:10.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18972025-03-25T22:01:10.845ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18982025-03-25T22:01:10.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18992025-03-25T22:01:10.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
19002025-03-25T22:01:10.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19012025-03-25T22:01:10.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19022025-03-25T22:01:10.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19032025-03-25T22:01:10.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19042025-03-25T22:01:10.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19052025-03-25T22:01:10.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
19062025-03-25T22:01:10.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19072025-03-25T22:01:10.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19082025-03-25T22:01:10.862ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
19092025-03-25T22:01:10.863ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.474968ms iteration = 6 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
19102025-03-25T22:01:10.875ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.0399ms iteration = 6 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19112025-03-25T22:01:11.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 15c41022-4abb-48b9-8a91-afbba9604e45 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
19122025-03-25T22:01:11.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 15c41022-4abb-48b9-8a91-afbba9604e45 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
19132025-03-25T22:01:11.117ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1866 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 15c41022-4abb-48b9-8a91-afbba9604e45 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
19142025-03-25T22:01:12.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 149973ac-5cda-4f4b-a19f-e28e5f2a0121 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
19152025-03-25T22:01:12.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 149973ac-5cda-4f4b-a19f-e28e5f2a0121 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
19162025-03-25T22:01:12.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2078 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 149973ac-5cda-4f4b-a19f-e28e5f2a0121 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
19172025-03-25T22:01:13.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 28c9afd7-17be-430a-9dc4-d63f4a83a1d1 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
19182025-03-25T22:01:13.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 28c9afd7-17be-430a-9dc4-d63f4a83a1d1 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
19192025-03-25T22:01:13.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2255 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 28c9afd7-17be-430a-9dc4-d63f4a83a1d1 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
19202025-03-25T22:01:14.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 25692efa-6536-471c-8b67-b087cfca8e1c roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
19212025-03-25T22:01:14.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 25692efa-6536-471c-8b67-b087cfca8e1c resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
19222025-03-25T22:01:14.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2809 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 25692efa-6536-471c-8b67-b087cfca8e1c response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
19232025-03-25T22:01:15.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 41146219-6882-4576-aabe-fb3055ce4623 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
19242025-03-25T22:01:15.203ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 41146219-6882-4576-aabe-fb3055ce4623 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
19252025-03-25T22:01:15.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1929 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 41146219-6882-4576-aabe-fb3055ce4623 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
19262025-03-25T22:01:16.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d5502910-71ff-4e86-827e-2153e734ea3e roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
19272025-03-25T22:01:16.225ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d5502910-71ff-4e86-827e-2153e734ea3e resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
19282025-03-25T22:01:16.227ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2473 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d5502910-71ff-4e86-827e-2153e734ea3e response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
19292025-03-25T22:01:17.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5d3e8e0e-084c-481e-8fbe-6f1651e50e10 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
19302025-03-25T22:01:17.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5d3e8e0e-084c-481e-8fbe-6f1651e50e10 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
19312025-03-25T22:01:17.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2173 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5d3e8e0e-084c-481e-8fbe-6f1651e50e10 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
19322025-03-25T22:01:18.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 79f6dd8e-feea-45d5-a2e7-91ccc40d57c9 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
19332025-03-25T22:01:18.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 79f6dd8e-feea-45d5-a2e7-91ccc40d57c9 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
19342025-03-25T22:01:18.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2392 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 79f6dd8e-feea-45d5-a2e7-91ccc40d57c9 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
19352025-03-25T22:01:19.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d0d09ecd-ae55-49d7-b494-bde565d0ba37 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
19362025-03-25T22:01:19.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d0d09ecd-ae55-49d7-b494-bde565d0ba37 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
19372025-03-25T22:01:19.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2310 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d0d09ecd-ae55-49d7-b494-bde565d0ba37 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
19382025-03-25T22:01:20.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 799f864d-202c-41cc-afa7-54338268b993 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
19392025-03-25T22:01:20.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 799f864d-202c-41cc-afa7-54338268b993 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
19402025-03-25T22:01:20.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2018 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 799f864d-202c-41cc-afa7-54338268b993 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
19412025-03-25T22:01:20.842ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 3 reason = Timeout
19422025-03-25T22:01:20.842ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 3 reason = Timeout
19432025-03-25T22:01:20.842ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:82 reason = blueprint disabled target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7
19442025-03-25T22:01:20.842ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19452025-03-25T22:01:20.842ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.92\u{b5}s iteration = 3 status = {"enabled":false,"target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7"}
19462025-03-25T22:01:20.842ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 2 reason = Timeout
19472025-03-25T22:01:20.842ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
19482025-03-25T22:01:20.842ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19492025-03-25T22:01:20.842ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 5 reason = Timeout
19502025-03-25T22:01:20.842ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 2 reason = Timeout
19512025-03-25T22:01:20.842ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-03-25 21:51:20.842506972 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
19522025-03-25T22:01:20.842ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19532025-03-25T22:01:20.842ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
19542025-03-25T22:01:20.842ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 3 reason = Timeout
19552025-03-25T22:01:20.842ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
19562025-03-25T22:01:20.842ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 2 reason = Timeout
19572025-03-25T22:01:20.842ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 7 reason = Timeout
19582025-03-25T22:01:20.842ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19592025-03-25T22:01:20.842ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 3 reason = Timeout
19602025-03-25T22:01:20.842ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 3 reason = Timeout
19612025-03-25T22:01:20.842ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19622025-03-25T22:01:20.842ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
19632025-03-25T22:01:20.842ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 2 reason = Timeout
19642025-03-25T22:01:20.842ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19652025-03-25T22:01:20.842ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 3 reason = Timeout
19662025-03-25T22:01:20.842ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
19672025-03-25T22:01:20.842ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 2 reason = Timeout
19682025-03-25T22:01:20.842ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
19692025-03-25T22:01:20.842ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 17.35\u{b5}s iteration = 3 status = {"error":"no config"}
19702025-03-25T22:01:20.842ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19712025-03-25T22:01:20.842ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 3 reason = Timeout
19722025-03-25T22:01:20.842ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 2 reason = Timeout
19732025-03-25T22:01:20.842ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
19742025-03-25T22:01:20.842ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 3 reason = Timeout
19752025-03-25T22:01:20.842ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
19762025-03-25T22:01:20.842ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 3 reason = Timeout
19772025-03-25T22:01:20.842ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19782025-03-25T22:01:20.842ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
19792025-03-25T22:01:20.842ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 3 reason = Timeout
19802025-03-25T22:01:20.842ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
19812025-03-25T22:01:20.842ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 2 reason = Timeout
19822025-03-25T22:01:20.842ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 7.671\u{b5}s iteration = 3 status = {"error":"no config"}
19832025-03-25T22:01:20.842ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 3 reason = Timeout
19842025-03-25T22:01:20.842ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
19852025-03-25T22:01:20.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19862025-03-25T22:01:20.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19872025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19882025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
19892025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
19902025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
19912025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
19922025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19932025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19942025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19952025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19962025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19972025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
19982025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
19992025-03-25T22:01:20.843ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("58d382a7-99da-40a7-bc9f-2da7e9b156c1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d42076c6-06fe-4102-a978-c7d0a8dffb98.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d42076c6-06fe-4102-a978-c7d0a8dffb98.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 6234, tv_nsec: 180047264 } })
20002025-03-25T22:01:20.843ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5533f428-2028-4269-b7b1-f15912c01133.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("66b022b6-2e12-413e-b4b7-56c4ad5bdd77.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f337d25b-c67a-4a32-89e1-e187aea97ed9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f337d25b-c67a-4a32-89e1-e187aea97ed9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 6234, tv_nsec: 180099345 } })
20012025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 7 reason = Timeout
20022025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20032025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 2 reason = Timeout
20042025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 3 reason = Timeout
20052025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
20062025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
20072025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 3 reason = Timeout
20082025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
20092025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 3 reason = Timeout
20102025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
20112025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 3 reason = Timeout
20122025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 3 reason = Timeout
20132025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
20142025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
20152025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 3 reason = Timeout
20162025-03-25T22:01:20.843ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
20172025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20182025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 2 reason = Timeout
20192025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
20202025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 3 reason = Timeout
20212025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
20222025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20232025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 3 reason = Timeout
20242025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
20252025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 2 reason = Timeout
20262025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
20272025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20282025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
20292025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
20302025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
20312025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20322025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
20332025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
20342025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20352025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
20362025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
20372025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
20382025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
20392025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
20402025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
20412025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.364724ms iteration = 2 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
20422025-03-25T22:01:20.843ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.191871ms iteration = 2 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
20432025-03-25T22:01:20.844ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20442025-03-25T22:01:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20452025-03-25T22:01:20.845ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20462025-03-25T22:01:20.846ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.836747ms iteration = 3 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
20472025-03-25T22:01:20.847ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6234, tv_nsec: 183893441 } })
20482025-03-25T22:01:20.847ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1171
20492025-03-25T22:01:20.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
20502025-03-25T22:01:20.847ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-03-25 21:51:20.842506972 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
20512025-03-25T22:01:20.847ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20522025-03-25T22:01:20.847ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.17031ms iteration = 2 status = {"expiration":"2025-03-25T21:51:20.842506972Z","pruned":[]}
20532025-03-25T22:01:20.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20542025-03-25T22:01:20.847ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20552025-03-25T22:01:20.849ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20562025-03-25T22:01:20.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20572025-03-25T22:01:20.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
20582025-03-25T22:01:20.849ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
20592025-03-25T22:01:20.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
20602025-03-25T22:01:20.849ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20612025-03-25T22:01:20.850ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20622025-03-25T22:01:20.852ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
20632025-03-25T22:01:20.852ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20642025-03-25T22:01:20.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20652025-03-25T22:01:20.852ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6234, tv_nsec: 189148272 } })
20662025-03-25T22:01:20.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
20672025-03-25T22:01:20.852ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1171
20682025-03-25T22:01:20.852ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20692025-03-25T22:01:20.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20702025-03-25T22:01:20.853ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20712025-03-25T22:01:20.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20722025-03-25T22:01:20.855ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20732025-03-25T22:01:20.857ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
20742025-03-25T22:01:20.857ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20752025-03-25T22:01:20.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20762025-03-25T22:01:20.858ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 15.524952ms iteration = 3 status = {"errors":[],"requests_created_ok":[]}
20772025-03-25T22:01:20.860ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 17.341072ms iteration = 3 status = {"errors":[],"garbage_collect_requested":[]}
20782025-03-25T22:01:20.862ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20792025-03-25T22:01:20.862ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 18.656676ms iteration = 2 status = {"errors":[],"found_port_ok":[]}
20802025-03-25T22:01:20.863ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
20812025-03-25T22:01:20.863ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20822025-03-25T22:01:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20832025-03-25T22:01:20.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
20842025-03-25T22:01:20.865ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20852025-03-25T22:01:20.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20862025-03-25T22:01:20.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
20872025-03-25T22:01:20.866ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6234, tv_nsec: 203531534 } })
20882025-03-25T22:01:20.867ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1171 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
20892025-03-25T22:01:20.882ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20902025-03-25T22:01:20.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20912025-03-25T22:01:20.887ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20922025-03-25T22:01:20.889ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20932025-03-25T22:01:20.889ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20942025-03-25T22:01:20.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20952025-03-25T22:01:20.892ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20962025-03-25T22:01:20.894ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20972025-03-25T22:01:20.894ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20982025-03-25T22:01:20.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20992025-03-25T22:01:20.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21002025-03-25T22:01:20.905ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21012025-03-25T22:01:20.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21022025-03-25T22:01:20.908ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
21032025-03-25T22:01:20.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21042025-03-25T22:01:20.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21052025-03-25T22:01:20.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
21062025-03-25T22:01:20.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21072025-03-25T22:01:20.912ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21082025-03-25T22:01:20.913ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
21092025-03-25T22:01:20.913ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
21102025-03-25T22:01:20.913ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
21112025-03-25T22:01:20.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
21122025-03-25T22:01:20.914ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21132025-03-25T22:01:20.916ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
21142025-03-25T22:01:20.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
21152025-03-25T22:01:20.917ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
21162025-03-25T22:01:20.917ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21172025-03-25T22:01:20.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21182025-03-25T22:01:20.917ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
21192025-03-25T22:01:20.918ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21202025-03-25T22:01:20.919ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 76.15671ms iteration = 3 status = {"errors":[],"finish_invoked_ok":[]}
21212025-03-25T22:01:20.920ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
21222025-03-25T22:01:20.920ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
21232025-03-25T22:01:20.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
21242025-03-25T22:01:20.923ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21252025-03-25T22:01:20.924ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
21262025-03-25T22:01:20.924ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
21272025-03-25T22:01:20.924ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 81.347931ms iteration = 2 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
21282025-03-25T22:01:20.925ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
21292025-03-25T22:01:20.925ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21302025-03-25T22:01:20.925ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "95a950b2-0518-402c-9a16-a069257dce3b", "content-length": "26", "date": "Tue, 25 Mar 2025 22:01:20 GMT"} })
21312025-03-25T22:01:20.925ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21322025-03-25T22:01:20.926ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
21332025-03-25T22:01:20.926ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
21342025-03-25T22:01:20.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
21352025-03-25T22:01:20.927ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
21362025-03-25T22:01:20.935ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
21372025-03-25T22:01:20.935ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
21382025-03-25T22:01:20.935ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
21392025-03-25T22:01:20.935ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21402025-03-25T22:01:20.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21412025-03-25T22:01:20.937ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21422025-03-25T22:01:20.938ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
21432025-03-25T22:01:20.938ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21442025-03-25T22:01:20.938ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "15a3c403-0590-45e1-86f5-a749edfae2d2", "content-length": "26", "date": "Tue, 25 Mar 2025 22:01:20 GMT"} })
21452025-03-25T22:01:20.938ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21462025-03-25T22:01:20.939ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 96.13556ms iteration = 3 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
21472025-03-25T22:01:20.939ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21482025-03-25T22:01:20.940ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
21492025-03-25T22:01:20.941ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
21502025-03-25T22:01:20.941ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
21512025-03-25T22:01:20.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
21522025-03-25T22:01:20.942ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21532025-03-25T22:01:20.943ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
21542025-03-25T22:01:20.943ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21552025-03-25T22:01:20.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21562025-03-25T22:01:20.943ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
21572025-03-25T22:01:20.943ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
21582025-03-25T22:01:20.943ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 100.410494ms iteration = 2 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
21592025-03-25T22:01:20.945ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
21602025-03-25T22:01:20.945ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21612025-03-25T22:01:20.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21622025-03-25T22:01:20.964ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
21632025-03-25T22:01:20.964ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
21642025-03-25T22:01:20.964ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
21652025-03-25T22:01:20.964ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
21662025-03-25T22:01:20.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
21672025-03-25T22:01:20.968ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
21682025-03-25T22:01:20.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
21692025-03-25T22:01:20.986ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 zone_address = fd00:1122:3344:101::2
21702025-03-25T22:01:20.986ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21712025-03-25T22:01:20.986ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a38293c-011c-41bb-8f99-bca0e66f478e", "content-length": "26", "date": "Tue, 25 Mar 2025 22:01:20 GMT"} })
21722025-03-25T22:01:20.986ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1184 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21732025-03-25T22:01:20.987ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
21742025-03-25T22:01:21.038ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
21752025-03-25T22:01:21.039ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "425679e0-dbae-413b-b474-a2648ecd438d", "content-length": "1", "date": "Tue, 25 Mar 2025 22:01:20 GMT"} })
21762025-03-25T22:01:21.040ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
21772025-03-25T22:01:21.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
21782025-03-25T22:01:21.077ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
21792025-03-25T22:01:21.078ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "405ad47e-a84d-480d-b201-f4b31d86fc1e", "content-length": "691", "date": "Tue, 25 Mar 2025 22:01:21 GMT"} })
21802025-03-25T22:01:21.078ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
21812025-03-25T22:01:21.078ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
21822025-03-25T22:01:21.078ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
21832025-03-25T22:01:21.080ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 236.773306ms iteration = 7 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21842025-03-25T22:01:21.080ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 238.040758ms iteration = 3 status = {}
21852025-03-25T22:01:21.082ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21862025-03-25T22:01:21.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21872025-03-25T22:01:21.083ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21882025-03-25T22:01:21.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21892025-03-25T22:01:21.092ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 249.742933ms iteration = 3 status = null
21902025-03-25T22:01:21.126ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 283.979361ms iteration = 3 status = {}
21912025-03-25T22:01:21.157ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
21922025-03-25T22:01:21.157ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
21932025-03-25T22:01:21.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
21942025-03-25T22:01:21.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
21952025-03-25T22:01:21.158ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
21962025-03-25T22:01:21.158ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 314.819799ms iteration = 3 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
21972025-03-25T22:01:21.162ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21982025-03-25T22:01:21.163ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 321.103549ms iteration = 3 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
21992025-03-25T22:01:21.168ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
22002025-03-25T22:01:21.168ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22012025-03-25T22:01:21.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22022025-03-25T22:01:21.169ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
22032025-03-25T22:01:21.169ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
22042025-03-25T22:01:21.169ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
22052025-03-25T22:01:21.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
22062025-03-25T22:01:21.170ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22072025-03-25T22:01:21.170ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22082025-03-25T22:01:21.173ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
22092025-03-25T22:01:21.173ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
22102025-03-25T22:01:21.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
22112025-03-25T22:01:21.174ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
22122025-03-25T22:01:21.174ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22132025-03-25T22:01:21.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22142025-03-25T22:01:21.176ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:360
22152025-03-25T22:01:21.176ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 333.481736ms iteration = 3 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
22162025-03-25T22:01:21.176ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22172025-03-25T22:01:21.176ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22182025-03-25T22:01:21.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22192025-03-25T22:01:21.178ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22202025-03-25T22:01:21.180ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
22212025-03-25T22:01:21.180ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22222025-03-25T22:01:21.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22232025-03-25T22:01:21.181ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
22242025-03-25T22:01:21.181ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22252025-03-25T22:01:21.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22262025-03-25T22:01:21.195ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
22272025-03-25T22:01:21.195ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 352.794903ms iteration = 7 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
22282025-03-25T22:01:21.216ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 372.66621ms iteration = 3 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
22292025-03-25T22:01:21.224ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
22302025-03-25T22:01:21.224ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 23d93905-7b89-4296-b050-7ff9ae235c15 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
22312025-03-25T22:01:21.224ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22322025-03-25T22:01:21.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22332025-03-25T22:01:21.227ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22342025-03-25T22:01:21.227ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22352025-03-25T22:01:21.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22362025-03-25T22:01:21.228ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
22372025-03-25T22:01:21.228ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
22382025-03-25T22:01:21.228ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 384.910944ms iteration = 3 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
22392025-03-25T22:01:21.231ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
22402025-03-25T22:01:21.231ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22412025-03-25T22:01:21.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22422025-03-25T22:01:21.235ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a5db250-fa3f-4168-ab16-5c36568c22e2, rack_id: c7210e4b-5a81-4ec8-b8fe-816a9508dc74, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(6d5dda50-e3c4-4853-9bfa-a66b447ab351) } rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
22432025-03-25T22:01:21.235ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22442025-03-25T22:01:21.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22452025-03-25T22:01:21.247ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 23d93905-7b89-4296-b050-7ff9ae235c15 dns_zone_name = control-plane.oxide.internal found_so_far = 52 version = 1
22462025-03-25T22:01:21.249ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
22472025-03-25T22:01:21.249ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_internal dns_group = internal file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 1
22482025-03-25T22:01:21.249ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 407.378566ms iteration = 2 status = {"generation":1}
22492025-03-25T22:01:21.249ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 4 reason = Dependency
22502025-03-25T22:01:21.251ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
22512025-03-25T22:01:21.252ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "49bae63f-acd2-4740-94fc-ef7c61f840f6", "content-length": "134", "date": "Tue, 25 Mar 2025 22:01:20 GMT"} })
22522025-03-25T22:01:21.252ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
22532025-03-25T22:01:21.252ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 6d5dda50-e3c4-4853-9bfa-a66b447ab351
22542025-03-25T22:01:21.252ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
22552025-03-25T22:01:21.252ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
22562025-03-25T22:01:21.252ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22572025-03-25T22:01:21.252ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22582025-03-25T22:01:21.252ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22592025-03-25T22:01:21.252ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
22602025-03-25T22:01:21.252ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22612025-03-25T22:01:21.252ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
22622025-03-25T22:01:21.252ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
22632025-03-25T22:01:21.253ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22642025-03-25T22:01:21.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22652025-03-25T22:01:21.254ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
22662025-03-25T22:01:21.254ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 96679ce4-e18c-487b-803a-7b26be55e85c dns_zone_name = oxide.test found_so_far = 0 version = 2
22672025-03-25T22:01:21.254ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22682025-03-25T22:01:21.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22692025-03-25T22:01:21.256ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22702025-03-25T22:01:21.262ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
22712025-03-25T22:01:21.262ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22722025-03-25T22:01:21.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22732025-03-25T22:01:21.264ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
22742025-03-25T22:01:21.264ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "42840d93-767e-483a-a8c2-7c74af97b518", "content-length": "2", "date": "Tue, 25 Mar 2025 22:01:20 GMT"} })
22752025-03-25T22:01:21.264ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
22762025-03-25T22:01:21.264ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee7800c6-883b-45c3-86ad-4aeddf2362e0", "content-length": "52", "date": "Tue, 25 Mar 2025 22:01:20 GMT"} })
22772025-03-25T22:01:21.264ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
22782025-03-25T22:01:21.264ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
22792025-03-25T22:01:21.264ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 96679ce4-e18c-487b-803a-7b26be55e85c dns_zone_name = oxide.test found_so_far = 1 version = 2
22802025-03-25T22:01:21.265ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
22812025-03-25T22:01:21.265ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_external dns_group = external file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 2
22822025-03-25T22:01:21.265ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 422.343177ms iteration = 2 status = {"generation":2}
22832025-03-25T22:01:21.265ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 4 reason = Dependency
22842025-03-25T22:01:21.267ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
22852025-03-25T22:01:21.267ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 423.697871ms iteration = 2 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
22862025-03-25T22:01:21.274ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (initial) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-03-25T22:00:16.382271Z, time_modified: 2025-03-25T22:00:16.382271Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, db_silo: Silo { identity: SiloIdentity { id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-25T22:00:22.501108Z, time_modified: 2025-03-25T22:00:22.501108Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, db_silo: Silo { identity: SiloIdentity { id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-25T22:00:22.501108Z, time_modified: 2025-03-25T22:00:22.501108Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:77
22872025-03-25T22:01:21.274ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 431.835563ms iteration = 2 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"5c35ff8c-21dd-48b9-9751-76bfa681bc38","tls_certs":["0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d"]}},"default_endpoint":{"silo_id":"5c35ff8c-21dd-48b9-9751-76bfa681bc38","tls_certs":["0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
22882025-03-25T22:01:21.276ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 433.759747ms iteration = 5 status = {"physical_disks_added":0}
22892025-03-25T22:01:21.282ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
22902025-03-25T22:01:21.282ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
22912025-03-25T22:01:21.313ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = / versions = all
22922025-03-25T22:01:21.313ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /access versions = all
22932025-03-25T22:01:21.313ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /assets/{path} versions = all
22942025-03-25T22:01:21.313ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/auth versions = all
22952025-03-25T22:01:21.313ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/confirm versions = all
22962025-03-25T22:01:21.313ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /device/success versions = all
22972025-03-25T22:01:21.313ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/token versions = all
22982025-03-25T22:01:21.313ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /device/verify versions = all
22992025-03-25T22:01:21.313ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/probes versions = all
23002025-03-25T22:01:21.313ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /experimental/v1/probes versions = all
23012025-03-25T22:01:21.313ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /experimental/v1/probes/{probe} versions = all
23022025-03-25T22:01:21.313ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/probes/{probe} versions = all
23032025-03-25T22:01:21.313ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/system/support-bundles versions = all
23042025-03-25T22:01:21.313ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /experimental/v1/system/support-bundles versions = all
23052025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /experimental/v1/system/support-bundles/{support_bundle} versions = all
23062025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/system/support-bundles/{support_bundle} versions = all
23072025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/download versions = all
23082025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = HEAD path = /experimental/v1/system/support-bundles/{support_bundle}/download versions = all
23092025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/download/{file} versions = all
23102025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = HEAD path = /experimental/v1/system/support-bundles/{support_bundle}/download/{file} versions = all
23112025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/index versions = all
23122025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /images versions = all
23132025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login versions = all
23142025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/local versions = all
23152025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
23162025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
23172025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
23182025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /lookup/{path} versions = all
23192025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /projects/{path} versions = all
23202025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /projects-new versions = all
23212025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /settings/{path} versions = all
23222025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /system/{path} versions = all
23232025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /utilization versions = all
23242025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/affinity-groups versions = all
23252025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/affinity-groups versions = all
23262025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/affinity-groups/{affinity_group} versions = all
23272025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/affinity-groups/{affinity_group} versions = all
23282025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/affinity-groups/{affinity_group} versions = all
23292025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/affinity-groups/{affinity_group}/members versions = all
23302025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/affinity-groups/{affinity_group}/members/instance/{instance} versions = all
23312025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/affinity-groups/{affinity_group}/members/instance/{instance} versions = all
23322025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/affinity-groups/{affinity_group}/members/instance/{instance} versions = all
23332025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/anti-affinity-groups versions = all
23342025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/anti-affinity-groups versions = all
23352025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/anti-affinity-groups/{anti_affinity_group} versions = all
23362025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/anti-affinity-groups/{anti_affinity_group} versions = all
23372025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/anti-affinity-groups/{anti_affinity_group} versions = all
23382025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/anti-affinity-groups/{anti_affinity_group}/members versions = all
23392025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/anti-affinity-groups/{anti_affinity_group}/members/instance/{instance} versions = all
23402025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/anti-affinity-groups/{anti_affinity_group}/members/instance/{instance} versions = all
23412025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/anti-affinity-groups/{anti_affinity_group}/members/instance/{instance} versions = all
23422025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/certificates versions = all
23432025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/certificates versions = all
23442025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/certificates/{certificate} versions = all
23452025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/certificates/{certificate} versions = all
23462025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks versions = all
23472025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks versions = all
23482025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/disks/{disk} versions = all
23492025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks/{disk} versions = all
23502025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write versions = all
23512025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
23522025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
23532025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/finalize versions = all
23542025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks/{disk}/metrics/{metric} versions = all
23552025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/floating-ips versions = all
23562025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips versions = all
23572025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
23582025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/floating-ips/{floating_ip} versions = all
23592025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
23602025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
23612025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
23622025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/groups versions = all
23632025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/groups/{group_id} versions = all
23642025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/images versions = all
23652025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images versions = all
23662025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/images/{image} versions = all
23672025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/images/{image} versions = all
23682025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images/{image}/demote versions = all
23692025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images/{image}/promote versions = all
23702025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances versions = all
23712025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances versions = all
23722025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/instances/{instance} versions = all
23732025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance} versions = all
23742025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/instances/{instance} versions = all
23752025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/disks versions = all
23762025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/disks/attach versions = all
23772025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/disks/detach versions = all
23782025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/external-ips versions = all
23792025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all
23802025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all
23812025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/reboot versions = all
23822025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/serial-console versions = all
23832025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
23842025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
23852025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/start versions = all
23862025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/stop versions = all
23872025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateway-ip-addresses versions = all
23882025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/internet-gateway-ip-addresses versions = all
23892025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
23902025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateway-ip-pools versions = all
23912025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/internet-gateway-ip-pools versions = all
23922025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
23932025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateways versions = all
23942025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/internet-gateways versions = all
23952025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
23962025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateways/{gateway} versions = all
23972025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ip-pools versions = all
23982025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ip-pools/{pool} versions = all
23992025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/login/{silo_name}/local versions = all
24002025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/logout versions = all
24012025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me versions = all
24022025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/groups versions = all
24032025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/ssh-keys versions = all
24042025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/me/ssh-keys versions = all
24052025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
24062025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
24072025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/metrics/{metric_name} versions = all
24082025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/network-interfaces versions = all
24092025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/network-interfaces versions = all
24102025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/network-interfaces/{interface} versions = all
24112025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/network-interfaces/{interface} versions = all
24122025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/network-interfaces/{interface} versions = all
24132025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ping versions = all
24142025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/policy versions = all
24152025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/policy versions = all
24162025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects versions = all
24172025-03-25T22:01:21.314ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/projects versions = all
24182025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/projects/{project} versions = all
24192025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects/{project} versions = all
24202025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/projects/{project} versions = all
24212025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects/{project}/policy versions = all
24222025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/projects/{project}/policy versions = all
24232025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/snapshots versions = all
24242025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/snapshots versions = all
24252025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/snapshots/{snapshot} versions = all
24262025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/snapshots/{snapshot} versions = all
24272025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/disks versions = all
24282025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
24292025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/rack-switch-port/{rack_id}/{switch_location}/{port}/lldp/neighbors versions = all
24302025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/racks versions = all
24312025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
24322025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds versions = all
24332025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/hardware/sleds versions = all
24342025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
24352025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
24362025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
24372025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
24382025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
24392025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switch-port versions = all
24402025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switch-port/{port}/lldp/config versions = all
24412025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/hardware/switch-port/{port}/lldp/config versions = all
24422025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
24432025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
24442025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
24452025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switches versions = all
24462025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
24472025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/identity-providers versions = all
24482025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/local/users versions = all
24492025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
24502025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
24512025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/saml versions = all
24522025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
24532025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools versions = all
24542025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools versions = all
24552025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/ip-pools/{pool} versions = all
24562025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool} versions = all
24572025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/ip-pools/{pool} versions = all
24582025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all
24592025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all
24602025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all
24612025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all
24622025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all
24632025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
24642025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
24652025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all
24662025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools-service versions = all
24672025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools-service/ranges versions = all
24682025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all
24692025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all
24702025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/metrics/{metric_name} versions = all
24712025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/address-lot versions = all
24722025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/address-lot versions = all
24732025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
24742025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
24752025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/allow-list versions = all
24762025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/networking/allow-list versions = all
24772025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bfd-disable versions = all
24782025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bfd-enable versions = all
24792025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bfd-status versions = all
24802025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/bgp versions = all
24812025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp versions = all
24822025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bgp versions = all
24832025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-announce-set versions = all
24842025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
24852025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
24862025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
24872025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-exported versions = all
24882025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-message-history versions = all
24892025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all
24902025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-status versions = all
24912025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/loopback-address versions = all
24922025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/loopback-address versions = all
24932025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
24942025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
24952025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/switch-port-settings versions = all
24962025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/switch-port-settings versions = all
24972025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all
24982025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/policy versions = all
24992025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/policy versions = all
25002025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/roles versions = all
25012025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/roles/{role_name} versions = all
25022025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silo-quotas versions = all
25032025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos versions = all
25042025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/silos versions = all
25052025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/silos/{silo} versions = all
25062025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo} versions = all
25072025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all
25082025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/policy versions = all
25092025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/silos/{silo}/policy versions = all
25102025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/quotas versions = all
25112025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
25122025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/timeseries/query versions = all
25132025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/timeseries/schemas versions = all
25142025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/update/repository versions = all
25152025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/update/repository/{system_version} versions = all
25162025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/update/target-release versions = all
25172025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/update/target-release versions = all
25182025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users versions = all
25192025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users/{user_id} versions = all
25202025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users-builtin versions = all
25212025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users-builtin/{user} versions = all
25222025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/utilization/silos versions = all
25232025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/utilization/silos/{silo} versions = all
25242025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/timeseries/query versions = all
25252025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/users versions = all
25262025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/utilization versions = all
25272025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-firewall-rules versions = all
25282025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-firewall-rules versions = all
25292025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-router-routes versions = all
25302025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-router-routes versions = all
25312025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
25322025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-router-routes/{route} versions = all
25332025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-router-routes/{route} versions = all
25342025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-routers versions = all
25352025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-routers versions = all
25362025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-routers/{router} versions = all
25372025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-routers/{router} versions = all
25382025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-routers/{router} versions = all
25392025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets versions = all
25402025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-subnets versions = all
25412025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
25422025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets/{subnet} versions = all
25432025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
25442025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all
25452025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpcs versions = all
25462025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpcs versions = all
25472025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpcs/{vpc} versions = all
25482025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpcs/{vpc} versions = all
25492025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpcs/{vpc} versions = all
25502025-03-25T22:01:21.315ZINFOnexus (dropshot_external): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = 172.30.2.7:443
25512025-03-25T22:01:21.315ZDEBGnexus (dropshot_external): successfully registered DTrace USDT probes local_addr = 172.30.2.7:443
25522025-03-25T22:01:21.324ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25532025-03-25T22:01:21.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25542025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = / versions = all
25552025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /access versions = all
25562025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /assets/{path} versions = all
25572025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/auth versions = all
25582025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/confirm versions = all
25592025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /device/success versions = all
25602025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/token versions = all
25612025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /device/verify versions = all
25622025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/probes versions = all
25632025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /experimental/v1/probes versions = all
25642025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /experimental/v1/probes/{probe} versions = all
25652025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/probes/{probe} versions = all
25662025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/system/support-bundles versions = all
25672025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /experimental/v1/system/support-bundles versions = all
25682025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /experimental/v1/system/support-bundles/{support_bundle} versions = all
25692025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/system/support-bundles/{support_bundle} versions = all
25702025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/download versions = all
25712025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = HEAD path = /experimental/v1/system/support-bundles/{support_bundle}/download versions = all
25722025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/download/{file} versions = all
25732025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = HEAD path = /experimental/v1/system/support-bundles/{support_bundle}/download/{file} versions = all
25742025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/index versions = all
25752025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /images versions = all
25762025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login versions = all
25772025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/local versions = all
25782025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
25792025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
25802025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
25812025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /lookup/{path} versions = all
25822025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /projects/{path} versions = all
25832025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /projects-new versions = all
25842025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /settings/{path} versions = all
25852025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /system/{path} versions = all
25862025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /utilization versions = all
25872025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/affinity-groups versions = all
25882025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/affinity-groups versions = all
25892025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/affinity-groups/{affinity_group} versions = all
25902025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/affinity-groups/{affinity_group} versions = all
25912025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/affinity-groups/{affinity_group} versions = all
25922025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/affinity-groups/{affinity_group}/members versions = all
25932025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/affinity-groups/{affinity_group}/members/instance/{instance} versions = all
25942025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/affinity-groups/{affinity_group}/members/instance/{instance} versions = all
25952025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/affinity-groups/{affinity_group}/members/instance/{instance} versions = all
25962025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/anti-affinity-groups versions = all
25972025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/anti-affinity-groups versions = all
25982025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/anti-affinity-groups/{anti_affinity_group} versions = all
25992025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/anti-affinity-groups/{anti_affinity_group} versions = all
26002025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/anti-affinity-groups/{anti_affinity_group} versions = all
26012025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/anti-affinity-groups/{anti_affinity_group}/members versions = all
26022025-03-25T22:01:21.325ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
26032025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/anti-affinity-groups/{anti_affinity_group}/members/instance/{instance} versions = all
26042025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/anti-affinity-groups/{anti_affinity_group}/members/instance/{instance} versions = all
26052025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/anti-affinity-groups/{anti_affinity_group}/members/instance/{instance} versions = all
26062025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/certificates versions = all
26072025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/certificates versions = all
26082025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/certificates/{certificate} versions = all
26092025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/certificates/{certificate} versions = all
26102025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks versions = all
26112025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks versions = all
26122025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/disks/{disk} versions = all
26132025-03-25T22:01:21.325ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks/{disk} versions = all
26142025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write versions = all
26152025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
26162025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
26172025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/finalize versions = all
26182025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks/{disk}/metrics/{metric} versions = all
26192025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/floating-ips versions = all
26202025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips versions = all
26212025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
26222025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/floating-ips/{floating_ip} versions = all
26232025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
26242025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
26252025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
26262025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/groups versions = all
26272025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/groups/{group_id} versions = all
26282025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/images versions = all
26292025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images versions = all
26302025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/images/{image} versions = all
26312025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/images/{image} versions = all
26322025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images/{image}/demote versions = all
26332025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images/{image}/promote versions = all
26342025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances versions = all
26352025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances versions = all
26362025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/instances/{instance} versions = all
26372025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance} versions = all
26382025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/instances/{instance} versions = all
26392025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/disks versions = all
26402025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/disks/attach versions = all
26412025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/disks/detach versions = all
26422025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/external-ips versions = all
26432025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all
26442025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all
26452025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/reboot versions = all
26462025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/serial-console versions = all
26472025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
26482025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
26492025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/start versions = all
26502025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/stop versions = all
26512025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateway-ip-addresses versions = all
26522025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/internet-gateway-ip-addresses versions = all
26532025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
26542025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateway-ip-pools versions = all
26552025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/internet-gateway-ip-pools versions = all
26562025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
26572025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateways versions = all
26582025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/internet-gateways versions = all
26592025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
26602025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateways/{gateway} versions = all
26612025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ip-pools versions = all
26622025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ip-pools/{pool} versions = all
26632025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/login/{silo_name}/local versions = all
26642025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/logout versions = all
26652025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me versions = all
26662025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/groups versions = all
26672025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/ssh-keys versions = all
26682025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/me/ssh-keys versions = all
26692025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
26702025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
26712025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/metrics/{metric_name} versions = all
26722025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/network-interfaces versions = all
26732025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/network-interfaces versions = all
26742025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/network-interfaces/{interface} versions = all
26752025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/network-interfaces/{interface} versions = all
26762025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/network-interfaces/{interface} versions = all
26772025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ping versions = all
26782025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/policy versions = all
26792025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/policy versions = all
26802025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects versions = all
26812025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/projects versions = all
26822025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/projects/{project} versions = all
26832025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects/{project} versions = all
26842025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/projects/{project} versions = all
26852025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects/{project}/policy versions = all
26862025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/projects/{project}/policy versions = all
26872025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/snapshots versions = all
26882025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/snapshots versions = all
26892025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/snapshots/{snapshot} versions = all
26902025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/snapshots/{snapshot} versions = all
26912025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/disks versions = all
26922025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
26932025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/rack-switch-port/{rack_id}/{switch_location}/{port}/lldp/neighbors versions = all
26942025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/racks versions = all
26952025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
26962025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds versions = all
26972025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/hardware/sleds versions = all
26982025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
26992025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
27002025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
27012025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
27022025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
27032025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switch-port versions = all
27042025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switch-port/{port}/lldp/config versions = all
27052025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/hardware/switch-port/{port}/lldp/config versions = all
27062025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
27072025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
27082025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
27092025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switches versions = all
27102025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
27112025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/identity-providers versions = all
27122025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/local/users versions = all
27132025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
27142025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
27152025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/saml versions = all
27162025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
27172025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools versions = all
27182025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools versions = all
27192025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/ip-pools/{pool} versions = all
27202025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool} versions = all
27212025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/ip-pools/{pool} versions = all
27222025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all
27232025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all
27242025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all
27252025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all
27262025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all
27272025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
27282025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
27292025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all
27302025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools-service versions = all
27312025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools-service/ranges versions = all
27322025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all
27332025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all
27342025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/metrics/{metric_name} versions = all
27352025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/address-lot versions = all
27362025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/address-lot versions = all
27372025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
27382025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
27392025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/allow-list versions = all
27402025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/networking/allow-list versions = all
27412025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bfd-disable versions = all
27422025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bfd-enable versions = all
27432025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bfd-status versions = all
27442025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/bgp versions = all
27452025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp versions = all
27462025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bgp versions = all
27472025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-announce-set versions = all
27482025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
27492025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
27502025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
27512025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-exported versions = all
27522025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-message-history versions = all
27532025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all
27542025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-status versions = all
27552025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/loopback-address versions = all
27562025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/loopback-address versions = all
27572025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
27582025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
27592025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/switch-port-settings versions = all
27602025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/switch-port-settings versions = all
27612025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all
27622025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/policy versions = all
27632025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/policy versions = all
27642025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/roles versions = all
27652025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/roles/{role_name} versions = all
27662025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silo-quotas versions = all
27672025-03-25T22:01:21.326ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos versions = all
27682025-03-25T22:01:21.327ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/silos versions = all
27692025-03-25T22:01:21.327ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/silos/{silo} versions = all
27702025-03-25T22:01:21.327ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo} versions = all
27712025-03-25T22:01:21.327ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all
27722025-03-25T22:01:21.327ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/policy versions = all
27732025-03-25T22:01:21.327ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/silos/{silo}/policy versions = all
27742025-03-25T22:01:21.327ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/quotas versions = all
27752025-03-25T22:01:21.327ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
27762025-03-25T22:01:21.327ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/timeseries/query versions = all
27772025-03-25T22:01:21.327ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/timeseries/schemas versions = all
27782025-03-25T22:01:21.327ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/update/repository versions = all
27792025-03-25T22:01:21.327ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/update/repository/{system_version} versions = all
27802025-03-25T22:01:21.327ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/update/target-release versions = all
27812025-03-25T22:01:21.327ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/update/target-release versions = all
27822025-03-25T22:01:21.327ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users versions = all
27832025-03-25T22:01:21.327ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users/{user_id} versions = all
27842025-03-25T22:01:21.327ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users-builtin versions = all
27852025-03-25T22:01:21.327ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users-builtin/{user} versions = all
27862025-03-25T22:01:21.327ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/utilization/silos versions = all
27872025-03-25T22:01:21.327ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/utilization/silos/{silo} versions = all
27882025-03-25T22:01:21.327ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/timeseries/query versions = all
27892025-03-25T22:01:21.327ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/users versions = all
27902025-03-25T22:01:21.327ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/utilization versions = all
27912025-03-25T22:01:21.327ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-firewall-rules versions = all
27922025-03-25T22:01:21.327ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-firewall-rules versions = all
27932025-03-25T22:01:21.327ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-router-routes versions = all
27942025-03-25T22:01:21.327ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-router-routes versions = all
27952025-03-25T22:01:21.327ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
27962025-03-25T22:01:21.327ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-router-routes/{route} versions = all
27972025-03-25T22:01:21.327ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-router-routes/{route} versions = all
27982025-03-25T22:01:21.327ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-routers versions = all
27992025-03-25T22:01:21.327ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-routers versions = all
28002025-03-25T22:01:21.327ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-routers/{router} versions = all
28012025-03-25T22:01:21.327ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-routers/{router} versions = all
28022025-03-25T22:01:21.327ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-routers/{router} versions = all
28032025-03-25T22:01:21.327ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets versions = all
28042025-03-25T22:01:21.327ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-subnets versions = all
28052025-03-25T22:01:21.327ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
28062025-03-25T22:01:21.327ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets/{subnet} versions = all
28072025-03-25T22:01:21.327ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
28082025-03-25T22:01:21.327ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all
28092025-03-25T22:01:21.327ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpcs versions = all
28102025-03-25T22:01:21.327ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpcs versions = all
28112025-03-25T22:01:21.327ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpcs/{vpc} versions = all
28122025-03-25T22:01:21.327ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpcs/{vpc} versions = all
28132025-03-25T22:01:21.327ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpcs/{vpc} versions = all
28142025-03-25T22:01:21.327ZINFOnexus (dropshot_external_techport): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fd00:1122:3344:101::c]:12228
28152025-03-25T22:01:21.327ZDEBGnexus (dropshot_external_techport): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:12228
28162025-03-25T22:01:21.327ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28172025-03-25T22:01:21.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28182025-03-25T22:01:21.330ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28192025-03-25T22:01:21.332ZDEBGnexus (nexus-producer-server): registered DTrace probes
28202025-03-25T22:01:21.334ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f034aaf6-2037-4cb4-8409-3ab31c15cc28, lookup_type: ById(f034aaf6-2037-4cb4-8409-3ab31c15cc28) } result = Ok(())
28212025-03-25T22:01:21.334ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28222025-03-25T22:01:21.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28232025-03-25T22:01:21.336ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 493.307577ms iteration = 3 status = 0
28242025-03-25T22:01:21.336ZDEBGnexus (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::c]:46418 method = GET path = /{producer_id} versions = all
28252025-03-25T22:01:21.337ZINFOnexus (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fd00:1122:3344:101::c]:46418
28262025-03-25T22:01:21.337ZDEBGnexus (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:46418
28272025-03-25T22:01:21.337ZDEBGnexus (nexus-producer-server): Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::c]:46418
28282025-03-25T22:01:21.337ZDEBGnexus (nexus-producer-server): Nexus IP provided explicitly, will use it addr = [fd00:1122:3344:101::c]:12221
28292025-03-25T22:01:21.337ZDEBGnexus (nexus-producer-server): starting producer registration task
28302025-03-25T22:01:21.338ZINFOnexus (nexus-producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::c]:46418 file = oximeter/producer/src/lib.rs:279 interval = 10s producer_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
28312025-03-25T22:01:21.338ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
28322025-03-25T22:01:21.338ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
28332025-03-25T22:01:21.338ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
28342025-03-25T22:01:21.384ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "459d4ece-9aae-4687-9b72-67bb6bc21d43", "date": "Tue, 25 Mar 2025 22:01:21 GMT"} })
28352025-03-25T22:01:21.384ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch = Switch0
28362025-03-25T22:01:21.384ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
28372025-03-25T22:01:21.385ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 9ba9ac8b-8a9b-4fa0-9a2f-e340ae63e175 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
28382025-03-25T22:01:21.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 9ba9ac8b-8a9b-4fa0-9a2f-e340ae63e175 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
28392025-03-25T22:01:21.385ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9a0548b1-0e17-42d6-96ea-dc55845d9d95", "content-length": "372", "date": "Tue, 25 Mar 2025 22:01:21 GMT"} })
28402025-03-25T22:01:21.385ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "4559f4f3-b36d-47ab-a478-4c67fc078098", "content-length": "682", "date": "Tue, 25 Mar 2025 22:01:21 GMT"} })
28412025-03-25T22:01:21.385ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28422025-03-25T22:01:21.385ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28432025-03-25T22:01:21.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28442025-03-25T22:01:21.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28452025-03-25T22:01:21.388ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2904 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 9ba9ac8b-8a9b-4fa0-9a2f-e340ae63e175 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
28462025-03-25T22:01:21.390ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28472025-03-25T22:01:21.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28482025-03-25T22:01:21.395ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28492025-03-25T22:01:21.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28502025-03-25T22:01:21.398ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28512025-03-25T22:01:21.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28522025-03-25T22:01:21.404ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
28532025-03-25T22:01:21.411ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 569.273565ms iteration = 3 status = {}
28542025-03-25T22:01:21.423ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
28552025-03-25T22:01:21.423ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:51123
28562025-03-25T22:01:21.425ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
28572025-03-25T22:01:21.425ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "3d3a850e-b3e1-43a2-9ad6-79bebe17c5f5", "date": "Tue, 25 Mar 2025 22:01:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
28582025-03-25T22:01:21.425ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
28592025-03-25T22:01:21.427ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "0685049c-418a-44cf-b522-5c35de424df5", "date": "Tue, 25 Mar 2025 22:01:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
28602025-03-25T22:01:21.427ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
28612025-03-25T22:01:21.428ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
28622025-03-25T22:01:21.430ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 165.45111ms iteration = 4 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
28632025-03-25T22:01:21.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:51123 req_id = d08507ef-248d-4914-8d7c-17586c7000f0 roles = RoleSet { roles: {} } uri = /metrics/producers
28642025-03-25T22:01:21.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:51123 req_id = d08507ef-248d-4914-8d7c-17586c7000f0 resource = Database result = Ok(()) uri = /metrics/producers
28652025-03-25T22:01:21.453ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
28662025-03-25T22:01:21.454ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "984c3c42-c805-49e3-88d4-4d6a5200cc82", "date": "Tue, 25 Mar 2025 22:01:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
28672025-03-25T22:01:21.454ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
28682025-03-25T22:01:21.455ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "43fe981c-c2f2-49a3-8862-121b096004b5", "date": "Tue, 25 Mar 2025 22:01:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
28692025-03-25T22:01:21.455ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
28702025-03-25T22:01:21.457ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "81012ec7-3429-43d6-a4ef-95ff2beb2266", "date": "Tue, 25 Mar 2025 22:01:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
28712025-03-25T22:01:21.457ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
28722025-03-25T22:01:21.458ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
28732025-03-25T22:01:21.458ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 208.810437ms iteration = 4 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
28742025-03-25T22:01:21.469ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
28752025-03-25T22:01:21.469ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
28762025-03-25T22:01:21.470ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "af51b482-90b3-45c2-abea-3515e1de0d52", "date": "Tue, 25 Mar 2025 22:01:21 GMT"} })
28772025-03-25T22:01:21.470ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28782025-03-25T22:01:21.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28792025-03-25T22:01:21.472ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28802025-03-25T22:01:21.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28812025-03-25T22:01:21.476ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28822025-03-25T22:01:21.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28832025-03-25T22:01:21.479ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
28842025-03-25T22:01:21.479ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
28852025-03-25T22:01:21.479ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "31aaef71-39d0-4557-8f73-d2f7e8a7baa1", "date": "Tue, 25 Mar 2025 22:01:21 GMT"} })
28862025-03-25T22:01:21.479ZINFOnexus: assigned collector to new producer collector_id = ec539d60-a406-4fe9-a658-fbc8b3fb545b file = nexus/src/app/oximeter.rs:76 producer_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
28872025-03-25T22:01:21.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 55884 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:51123 req_id = d08507ef-248d-4914-8d7c-17586c7000f0 response_code = 201 uri = /metrics/producers
28882025-03-25T22:01:21.479ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "d08507ef-248d-4914-8d7c-17586c7000f0", "content-length": "41", "date": "Tue, 25 Mar 2025 22:01:21 GMT"} })
28892025-03-25T22:01:21.480ZDEBGnexus (producer-registration-task): registered with nexus successfully
28902025-03-25T22:01:21.480ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
28912025-03-25T22:01:21.480ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 637.520466ms iteration = 3 status = {}
28922025-03-25T22:01:22.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 94d33c49-79f5-4cfb-b31d-01fb992d723f roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
28932025-03-25T22:01:22.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 94d33c49-79f5-4cfb-b31d-01fb992d723f resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
28942025-03-25T22:01:22.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2267 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 94d33c49-79f5-4cfb-b31d-01fb992d723f response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
28952025-03-25T22:01:23.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4f8ab540-736a-48c2-b87d-43e7fa627656 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
28962025-03-25T22:01:23.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4f8ab540-736a-48c2-b87d-43e7fa627656 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
28972025-03-25T22:01:23.439ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2330 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4f8ab540-736a-48c2-b87d-43e7fa627656 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
28982025-03-25T22:01:24.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = cad114d5-4348-4c41-857d-833194eb087e roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
28992025-03-25T22:01:24.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = cad114d5-4348-4c41-857d-833194eb087e resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29002025-03-25T22:01:24.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2175 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = cad114d5-4348-4c41-857d-833194eb087e response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29012025-03-25T22:01:25.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8bfba321-fb3a-42ed-8259-9aad6d21e32a roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29022025-03-25T22:01:25.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8bfba321-fb3a-42ed-8259-9aad6d21e32a resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29032025-03-25T22:01:25.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2408 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8bfba321-fb3a-42ed-8259-9aad6d21e32a response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29042025-03-25T22:01:26.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b7db8f65-298d-4d7c-9b75-66eeb992da4f roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29052025-03-25T22:01:26.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b7db8f65-298d-4d7c-9b75-66eeb992da4f resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29062025-03-25T22:01:26.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2602 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b7db8f65-298d-4d7c-9b75-66eeb992da4f response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29072025-03-25T22:01:27.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 821ebba5-d041-479d-aa35-3f478032665d roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29082025-03-25T22:01:27.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 821ebba5-d041-479d-aa35-3f478032665d resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29092025-03-25T22:01:27.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2163 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 821ebba5-d041-479d-aa35-3f478032665d response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29102025-03-25T22:01:28.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 10ad4754-2c60-4094-9d51-3ffcd41973ea roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29112025-03-25T22:01:28.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 10ad4754-2c60-4094-9d51-3ffcd41973ea resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29122025-03-25T22:01:28.548ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2087 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 10ad4754-2c60-4094-9d51-3ffcd41973ea response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29132025-03-25T22:01:29.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a3fc9efb-31ee-4c3b-8b71-3e5386fd568e roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29142025-03-25T22:01:29.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a3fc9efb-31ee-4c3b-8b71-3e5386fd568e resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29152025-03-25T22:01:29.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1902 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a3fc9efb-31ee-4c3b-8b71-3e5386fd568e response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29162025-03-25T22:01:30.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5eac12f5-229c-4082-860c-3419c430296d roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29172025-03-25T22:01:30.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5eac12f5-229c-4082-860c-3419c430296d resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29182025-03-25T22:01:30.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2228 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5eac12f5-229c-4082-860c-3419c430296d response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29192025-03-25T22:01:30.842ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 8 reason = Timeout
29202025-03-25T22:01:30.842ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29212025-03-25T22:01:30.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29222025-03-25T22:01:30.843ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 8 reason = Timeout
29232025-03-25T22:01:30.843ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29242025-03-25T22:01:30.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29252025-03-25T22:01:30.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29262025-03-25T22:01:30.846ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29272025-03-25T22:01:30.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29282025-03-25T22:01:30.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29292025-03-25T22:01:30.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29302025-03-25T22:01:30.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29312025-03-25T22:01:30.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29322025-03-25T22:01:30.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
29332025-03-25T22:01:30.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29342025-03-25T22:01:30.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29352025-03-25T22:01:30.862ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
29362025-03-25T22:01:30.862ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.228486ms iteration = 8 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
29372025-03-25T22:01:30.874ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29382025-03-25T22:01:30.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29392025-03-25T22:01:30.876ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.143388ms iteration = 8 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29402025-03-25T22:01:31.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c20be673-916b-43bd-87a4-5608e19a8117 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29412025-03-25T22:01:31.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c20be673-916b-43bd-87a4-5608e19a8117 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29422025-03-25T22:01:31.615ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1925 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c20be673-916b-43bd-87a4-5608e19a8117 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29432025-03-25T22:01:32.634ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 53a90f02-66f6-4670-b928-4fb08b6e9d26 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29442025-03-25T22:01:32.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 53a90f02-66f6-4670-b928-4fb08b6e9d26 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29452025-03-25T22:01:32.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2434 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 53a90f02-66f6-4670-b928-4fb08b6e9d26 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29462025-03-25T22:01:33.657ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ebd162ba-e202-4a1b-9584-d38ca0e76e59 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29472025-03-25T22:01:33.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ebd162ba-e202-4a1b-9584-d38ca0e76e59 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29482025-03-25T22:01:33.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1788 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ebd162ba-e202-4a1b-9584-d38ca0e76e59 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29492025-03-25T22:01:34.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = afabeef9-25c9-4f44-ad16-441817b84e4e roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29502025-03-25T22:01:34.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = afabeef9-25c9-4f44-ad16-441817b84e4e resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29512025-03-25T22:01:34.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2419 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = afabeef9-25c9-4f44-ad16-441817b84e4e response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29522025-03-25T22:01:35.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1e1043c4-7138-496a-b8af-f307549e5e20 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29532025-03-25T22:01:35.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1e1043c4-7138-496a-b8af-f307549e5e20 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29542025-03-25T22:01:35.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2655 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1e1043c4-7138-496a-b8af-f307549e5e20 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29552025-03-25T22:01:36.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e95c6bde-9fcb-4af9-94ab-50e5a01aa9e4 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29562025-03-25T22:01:36.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e95c6bde-9fcb-4af9-94ab-50e5a01aa9e4 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29572025-03-25T22:01:36.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2310 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e95c6bde-9fcb-4af9-94ab-50e5a01aa9e4 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29582025-03-25T22:01:37.744ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5a08057a-6e99-4412-8866-5a427114103a roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29592025-03-25T22:01:37.744ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5a08057a-6e99-4412-8866-5a427114103a resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29602025-03-25T22:01:37.750ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6255 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5a08057a-6e99-4412-8866-5a427114103a response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29612025-03-25T22:01:38.571ZINFOnexus (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:46418 remote_addr = [fd00:1122:3344:101::d]:61920
29622025-03-25T22:01:38.577ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5611 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = 13c86018-a839-456d-8f8e-62c2c6c47a17 response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
29632025-03-25T22:01:38.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 93485392-4cde-47c4-91e0-5646e37e3da4 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29642025-03-25T22:01:38.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 93485392-4cde-47c4-91e0-5646e37e3da4 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29652025-03-25T22:01:38.775ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1533 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 93485392-4cde-47c4-91e0-5646e37e3da4 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29662025-03-25T22:01:39.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5e8d8d7c-c21a-4e40-86cf-561b95975c10 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29672025-03-25T22:01:39.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5e8d8d7c-c21a-4e40-86cf-561b95975c10 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29682025-03-25T22:01:39.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2112 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5e8d8d7c-c21a-4e40-86cf-561b95975c10 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29692025-03-25T22:01:40.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 955d80b0-8ea4-4578-91f6-49ebe37e154f roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29702025-03-25T22:01:40.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 955d80b0-8ea4-4578-91f6-49ebe37e154f resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29712025-03-25T22:01:40.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2672 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 955d80b0-8ea4-4578-91f6-49ebe37e154f response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29722025-03-25T22:01:40.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 9 reason = Timeout
29732025-03-25T22:01:40.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29742025-03-25T22:01:40.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29752025-03-25T22:01:40.843ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 9 reason = Timeout
29762025-03-25T22:01:40.843ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29772025-03-25T22:01:40.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29782025-03-25T22:01:40.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29792025-03-25T22:01:40.845ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29802025-03-25T22:01:40.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29812025-03-25T22:01:40.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29822025-03-25T22:01:40.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29832025-03-25T22:01:40.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29842025-03-25T22:01:40.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29852025-03-25T22:01:40.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29862025-03-25T22:01:40.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29872025-03-25T22:01:40.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
29882025-03-25T22:01:40.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29892025-03-25T22:01:40.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29902025-03-25T22:01:40.863ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
29912025-03-25T22:01:40.863ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.494638ms iteration = 9 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
29922025-03-25T22:01:40.877ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.266791ms iteration = 9 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29932025-03-25T22:01:41.840ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0d73f032-8bb3-42ea-9352-2202a43ae5c0 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29942025-03-25T22:01:41.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0d73f032-8bb3-42ea-9352-2202a43ae5c0 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29952025-03-25T22:01:41.842ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2296 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0d73f032-8bb3-42ea-9352-2202a43ae5c0 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29962025-03-25T22:01:42.861ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 73d5c1c1-5bfe-4ab1-ad0c-0342226df29c roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29972025-03-25T22:01:42.861ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 73d5c1c1-5bfe-4ab1-ad0c-0342226df29c resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29982025-03-25T22:01:42.863ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2314 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 73d5c1c1-5bfe-4ab1-ad0c-0342226df29c response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
29992025-03-25T22:01:43.882ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 240789dc-dea1-4977-ba2b-49f92c64a388 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
30002025-03-25T22:01:43.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 240789dc-dea1-4977-ba2b-49f92c64a388 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
30012025-03-25T22:01:43.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2795 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 240789dc-dea1-4977-ba2b-49f92c64a388 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
30022025-03-25T22:01:44.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 714f12db-915f-432f-9d0b-2bd7045e67a9 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
30032025-03-25T22:01:44.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 714f12db-915f-432f-9d0b-2bd7045e67a9 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
30042025-03-25T22:01:44.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2186 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 714f12db-915f-432f-9d0b-2bd7045e67a9 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
30052025-03-25T22:01:45.930ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a24ecaa6-3701-425f-9749-d14f37795615 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
30062025-03-25T22:01:45.930ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a24ecaa6-3701-425f-9749-d14f37795615 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
30072025-03-25T22:01:45.932ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2282 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a24ecaa6-3701-425f-9749-d14f37795615 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
30082025-03-25T22:01:46.951ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 80ceb2dd-a52c-4295-935b-01edf3547e6a roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
30092025-03-25T22:01:46.951ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 80ceb2dd-a52c-4295-935b-01edf3547e6a resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
30102025-03-25T22:01:46.953ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2461 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 80ceb2dd-a52c-4295-935b-01edf3547e6a response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
30112025-03-25T22:01:47.973ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b8437cc2-f44c-481a-aa79-a649fcd342cd roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
30122025-03-25T22:01:47.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b8437cc2-f44c-481a-aa79-a649fcd342cd resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
30132025-03-25T22:01:47.975ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1809 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b8437cc2-f44c-481a-aa79-a649fcd342cd response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
30142025-03-25T22:01:48.572ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 559 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = c4a5b7ca-3762-452b-b74b-53fabebfe0eb response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
30152025-03-25T22:01:48.995ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = dc3baca3-59a9-4f0f-be7b-c071881d4c61 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
30162025-03-25T22:01:48.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = dc3baca3-59a9-4f0f-be7b-c071881d4c61 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
30172025-03-25T22:01:48.997ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2065 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = dc3baca3-59a9-4f0f-be7b-c071881d4c61 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
30182025-03-25T22:01:50.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4a9ec599-38ff-4d9b-b023-6a6d620cf48a roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
30192025-03-25T22:01:50.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4a9ec599-38ff-4d9b-b023-6a6d620cf48a resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
30202025-03-25T22:01:50.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2770 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4a9ec599-38ff-4d9b-b023-6a6d620cf48a response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
30212025-03-25T22:01:50.842ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 4 reason = Timeout
30222025-03-25T22:01:50.842ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
30232025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 4 reason = Timeout
30242025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 4 reason = Timeout
30252025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
30262025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 4 reason = Timeout
30272025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 10 reason = Timeout
30282025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30292025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30302025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 4 reason = Timeout
30312025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 4 reason = Timeout
30322025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30332025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 4 reason = Timeout
30342025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
30352025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
30362025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 4 reason = Timeout
30372025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30382025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 6 reason = Timeout
30392025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30402025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
30412025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
30422025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 10 reason = Timeout
30432025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 4 reason = Timeout
30442025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
30452025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30462025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30472025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30482025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
30492025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 4 reason = Timeout
30502025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 4 reason = Timeout
30512025-03-25T22:01:50.843ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
30522025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 4 reason = Timeout
30532025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 4 reason = Timeout
30542025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
30552025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
30562025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30572025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
30582025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30592025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 4 reason = Timeout
30602025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 4 reason = Timeout
30612025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
30622025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
30632025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 4 reason = Timeout
30642025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30652025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
30662025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30672025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
30682025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30692025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
30702025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
30712025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
30722025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30732025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
30742025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
30752025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30762025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
30772025-03-25T22:01:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30782025-03-25T22:01:50.846ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30792025-03-25T22:01:50.846ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6264, tv_nsec: 182981205 } })
30802025-03-25T22:01:50.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30812025-03-25T22:01:50.846ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.578202ms iteration = 4 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
30822025-03-25T22:01:50.846ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1171
30832025-03-25T22:01:50.846ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30842025-03-25T22:01:50.847ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30852025-03-25T22:01:50.847ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30862025-03-25T22:01:50.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
30872025-03-25T22:01:50.849ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30882025-03-25T22:01:50.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30892025-03-25T22:01:50.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30902025-03-25T22:01:50.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30912025-03-25T22:01:50.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
30922025-03-25T22:01:50.850ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30932025-03-25T22:01:50.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30942025-03-25T22:01:50.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30952025-03-25T22:01:50.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
30962025-03-25T22:01:50.850ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
30972025-03-25T22:01:50.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
30982025-03-25T22:01:50.851ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6264, tv_nsec: 188242837 } })
30992025-03-25T22:01:50.851ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
31002025-03-25T22:01:50.851ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31012025-03-25T22:01:50.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31022025-03-25T22:01:50.851ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1171
31032025-03-25T22:01:50.853ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31042025-03-25T22:01:50.854ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31052025-03-25T22:01:50.855ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 11.700175ms iteration = 4 status = {"errors":[],"garbage_collect_requested":[]}
31062025-03-25T22:01:50.856ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
31072025-03-25T22:01:50.856ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31082025-03-25T22:01:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
31092025-03-25T22:01:50.856ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
31102025-03-25T22:01:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31112025-03-25T22:01:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
31122025-03-25T22:01:50.859ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6264, tv_nsec: 196562422 } })
31132025-03-25T22:01:50.860ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1171 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
31142025-03-25T22:01:50.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31152025-03-25T22:01:50.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31162025-03-25T22:01:50.861ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
31172025-03-25T22:01:50.861ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
31182025-03-25T22:01:50.861ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31192025-03-25T22:01:50.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31202025-03-25T22:01:50.861ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31212025-03-25T22:01:50.861ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31222025-03-25T22:01:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31232025-03-25T22:01:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31242025-03-25T22:01:50.864ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31252025-03-25T22:01:50.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
31262025-03-25T22:01:50.867ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31272025-03-25T22:01:50.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31282025-03-25T22:01:50.897ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
31292025-03-25T22:01:50.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
31302025-03-25T22:01:50.902ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 58.538353ms iteration = 4 status = {"errors":[],"finish_invoked_ok":[]}
31312025-03-25T22:01:50.902ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 58.909189ms iteration = 4 status = {"errors":[],"requests_created_ok":[]}
31322025-03-25T22:01:50.906ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
31332025-03-25T22:01:50.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
31342025-03-25T22:01:50.907ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31352025-03-25T22:01:50.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31362025-03-25T22:01:50.909ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31372025-03-25T22:01:50.909ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31382025-03-25T22:01:50.909ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.8702ms iteration = 10 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
31392025-03-25T22:01:50.909ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
31402025-03-25T22:01:50.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
31412025-03-25T22:01:50.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
31422025-03-25T22:01:50.911ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
31432025-03-25T22:01:50.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
31442025-03-25T22:01:50.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
31452025-03-25T22:01:50.914ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31462025-03-25T22:01:50.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31472025-03-25T22:01:50.921ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
31482025-03-25T22:01:50.921ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31492025-03-25T22:01:50.921ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f951df5c-2d92-4abf-ba77-8f742a124e2c", "content-length": "26", "date": "Tue, 25 Mar 2025 22:01:49 GMT"} })
31502025-03-25T22:01:50.921ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31512025-03-25T22:01:50.924ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
31522025-03-25T22:01:50.924ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
31532025-03-25T22:01:50.924ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31542025-03-25T22:01:50.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31552025-03-25T22:01:50.925ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
31562025-03-25T22:01:50.927ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
31572025-03-25T22:01:50.927ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
31582025-03-25T22:01:50.927ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
31592025-03-25T22:01:50.927ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 83.868775ms iteration = 4 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
31602025-03-25T22:01:50.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
31612025-03-25T22:01:50.929ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31622025-03-25T22:01:50.931ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31632025-03-25T22:01:50.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31642025-03-25T22:01:50.932ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
31652025-03-25T22:01:50.932ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31662025-03-25T22:01:50.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31672025-03-25T22:01:50.933ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
31682025-03-25T22:01:50.933ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 90.265986ms iteration = 10 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
31692025-03-25T22:01:50.933ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31702025-03-25T22:01:50.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31712025-03-25T22:01:50.935ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31722025-03-25T22:01:50.936ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
31732025-03-25T22:01:50.936ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 93.191638ms iteration = 4 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
31742025-03-25T22:01:50.938ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f034aaf6-2037-4cb4-8409-3ab31c15cc28, lookup_type: ById(f034aaf6-2037-4cb4-8409-3ab31c15cc28) } result = Ok(())
31752025-03-25T22:01:50.938ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31762025-03-25T22:01:50.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31772025-03-25T22:01:50.941ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 98.111764ms iteration = 4 status = 0
31782025-03-25T22:01:50.963ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 121.005854ms iteration = 4 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
31792025-03-25T22:01:50.966ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:360
31802025-03-25T22:01:50.966ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 123.121861ms iteration = 4 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
31812025-03-25T22:01:50.977ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 134.018411ms iteration = 4 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
31822025-03-25T22:01:50.978ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
31832025-03-25T22:01:50.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
31842025-03-25T22:01:50.981ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 zone_address = fd00:1122:3344:101::2
31852025-03-25T22:01:50.981ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31862025-03-25T22:01:50.981ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1eeedc79-6981-4be7-a0c9-732825d588a0", "content-length": "26", "date": "Tue, 25 Mar 2025 22:01:50 GMT"} })
31872025-03-25T22:01:50.982ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1184 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31882025-03-25T22:01:50.983ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
31892025-03-25T22:01:50.983ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31902025-03-25T22:01:50.983ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc3eac15-d3d8-409c-9045-3303eea121eb", "content-length": "26", "date": "Tue, 25 Mar 2025 22:01:50 GMT"} })
31912025-03-25T22:01:50.983ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31922025-03-25T22:01:50.983ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
31932025-03-25T22:01:50.984ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
31942025-03-25T22:01:51.029ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
31952025-03-25T22:01:51.029ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "f784307c-8d1a-4dc9-933b-5d681008a60d", "content-length": "1", "date": "Tue, 25 Mar 2025 22:01:50 GMT"} })
31962025-03-25T22:01:51.030ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31972025-03-25T22:01:51.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31982025-03-25T22:01:51.032ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
31992025-03-25T22:01:51.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
32002025-03-25T22:01:51.037ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
32012025-03-25T22:01:51.037ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
32022025-03-25T22:01:51.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 84d4eddf-6475-4e69-bd6a-d2d2df605cf0 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
32032025-03-25T22:01:51.037ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "48d9522a-7fbb-43d1-8edb-b58bab45caf6", "content-length": "372", "date": "Tue, 25 Mar 2025 22:01:51 GMT"} })
32042025-03-25T22:01:51.037ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32052025-03-25T22:01:51.037ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 84d4eddf-6475-4e69-bd6a-d2d2df605cf0 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
32062025-03-25T22:01:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32072025-03-25T22:01:51.040ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 197.032402ms iteration = 6 status = {"physical_disks_added":0}
32082025-03-25T22:01:51.040ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 198.03152ms iteration = 4 status = null
32092025-03-25T22:01:51.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4194 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 84d4eddf-6475-4e69-bd6a-d2d2df605cf0 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
32102025-03-25T22:01:51.075ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 232.258877ms iteration = 4 status = {}
32112025-03-25T22:01:51.087ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 243.624236ms iteration = 4 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
32122025-03-25T22:01:51.120ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
32132025-03-25T22:01:51.120ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
32142025-03-25T22:01:51.120ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a8f634cb-1451-4de6-ac51-d25b082977a9", "date": "Tue, 25 Mar 2025 22:01:51 GMT"} })
32152025-03-25T22:01:51.120ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32162025-03-25T22:01:51.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32172025-03-25T22:01:51.123ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32182025-03-25T22:01:51.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32192025-03-25T22:01:51.126ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32202025-03-25T22:01:51.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32212025-03-25T22:01:51.130ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
32222025-03-25T22:01:51.130ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
32232025-03-25T22:01:51.130ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f87e8c79-9b9a-460a-a24f-89bceb267c9d", "date": "Tue, 25 Mar 2025 22:01:51 GMT"} })
32242025-03-25T22:01:51.132ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 288.969478ms iteration = 4 status = {}
32252025-03-25T22:01:51.174ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32262025-03-25T22:01:51.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32272025-03-25T22:01:51.177ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a5db250-fa3f-4168-ab16-5c36568c22e2, rack_id: c7210e4b-5a81-4ec8-b8fe-816a9508dc74, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(6d5dda50-e3c4-4853-9bfa-a66b447ab351) } rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
32282025-03-25T22:01:51.177ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32292025-03-25T22:01:51.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32302025-03-25T22:01:51.184ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32312025-03-25T22:01:51.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32322025-03-25T22:01:51.187ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
32332025-03-25T22:01:51.188ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "0143710c-314a-48bc-923b-c9e736cfe068", "content-length": "134", "date": "Tue, 25 Mar 2025 22:01:50 GMT"} })
32342025-03-25T22:01:51.188ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
32352025-03-25T22:01:51.188ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 6d5dda50-e3c4-4853-9bfa-a66b447ab351
32362025-03-25T22:01:51.188ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
32372025-03-25T22:01:51.188ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
32382025-03-25T22:01:51.188ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32392025-03-25T22:01:51.188ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32402025-03-25T22:01:51.188ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32412025-03-25T22:01:51.188ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
32422025-03-25T22:01:51.188ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32432025-03-25T22:01:51.188ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
32442025-03-25T22:01:51.188ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
32452025-03-25T22:01:51.188ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32462025-03-25T22:01:51.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32472025-03-25T22:01:51.192ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
32482025-03-25T22:01:51.192ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0234349-7f01-4fcb-a2ad-a15158a610b8", "content-length": "2", "date": "Tue, 25 Mar 2025 22:01:50 GMT"} })
32492025-03-25T22:01:51.192ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
32502025-03-25T22:01:51.192ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f01010e3-5f09-4fb7-8d11-4df4d4cce66a", "content-length": "52", "date": "Tue, 25 Mar 2025 22:01:50 GMT"} })
32512025-03-25T22:01:51.192ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
32522025-03-25T22:01:51.192ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
32532025-03-25T22:01:51.221ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32542025-03-25T22:01:51.223ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
32552025-03-25T22:01:51.223ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32562025-03-25T22:01:51.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32572025-03-25T22:01:51.252ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32582025-03-25T22:01:51.254ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
32592025-03-25T22:01:51.254ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32602025-03-25T22:01:51.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32612025-03-25T22:01:51.292ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "05756554-70a5-4d05-b29b-648ca7438209", "date": "Tue, 25 Mar 2025 22:01:51 GMT"} })
32622025-03-25T22:01:51.292ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch = Switch0
32632025-03-25T22:01:51.292ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
32642025-03-25T22:01:51.293ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "db0d8c33-e6ce-467d-a3b1-343218302f31", "content-length": "682", "date": "Tue, 25 Mar 2025 22:01:51 GMT"} })
32652025-03-25T22:01:51.293ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32662025-03-25T22:01:51.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32672025-03-25T22:01:51.309ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32682025-03-25T22:01:51.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32692025-03-25T22:01:51.313ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32702025-03-25T22:01:51.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32712025-03-25T22:01:51.315ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32722025-03-25T22:01:51.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32732025-03-25T22:01:51.345ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
32742025-03-25T22:01:51.348ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b735571-3841-4ce5-baa8-29538f558560", "content-length": "691", "date": "Tue, 25 Mar 2025 22:01:51 GMT"} })
32752025-03-25T22:01:51.348ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
32762025-03-25T22:01:51.348ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
32772025-03-25T22:01:51.348ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
32782025-03-25T22:01:51.349ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 506.05678ms iteration = 4 status = {}
32792025-03-25T22:01:51.351ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 508.496883ms iteration = 4 status = {}
32802025-03-25T22:01:52.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7a35ab29-10ab-43c9-b0d7-e65a4b2f7294 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
32812025-03-25T22:01:52.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7a35ab29-10ab-43c9-b0d7-e65a4b2f7294 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
32822025-03-25T22:01:52.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2577 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7a35ab29-10ab-43c9-b0d7-e65a4b2f7294 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
32832025-03-25T22:01:53.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5091de25-0f5f-42be-b82e-b72c26f9f54b roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
32842025-03-25T22:01:53.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5091de25-0f5f-42be-b82e-b72c26f9f54b resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
32852025-03-25T22:01:53.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3089 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5091de25-0f5f-42be-b82e-b72c26f9f54b response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
32862025-03-25T22:01:54.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c5f69f27-6cc8-4698-b4cd-400a7dcbf51e roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
32872025-03-25T22:01:54.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c5f69f27-6cc8-4698-b4cd-400a7dcbf51e resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
32882025-03-25T22:01:54.114ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2753 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c5f69f27-6cc8-4698-b4cd-400a7dcbf51e response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
32892025-03-25T22:01:55.134ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 340e2f74-9759-4e94-8660-7be0c0654e60 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
32902025-03-25T22:01:55.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 340e2f74-9759-4e94-8660-7be0c0654e60 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
32912025-03-25T22:01:55.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2217 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 340e2f74-9759-4e94-8660-7be0c0654e60 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
32922025-03-25T22:01:56.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 56946cfd-c558-488c-b06c-6db562ca0fbe roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
32932025-03-25T22:01:56.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 56946cfd-c558-488c-b06c-6db562ca0fbe resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
32942025-03-25T22:01:56.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2955 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 56946cfd-c558-488c-b06c-6db562ca0fbe response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
32952025-03-25T22:01:57.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a050169a-d7b9-4a52-ace6-067528c5d72f roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
32962025-03-25T22:01:57.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a050169a-d7b9-4a52-ace6-067528c5d72f resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
32972025-03-25T22:01:57.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2487 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a050169a-d7b9-4a52-ace6-067528c5d72f response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
32982025-03-25T22:01:58.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5138edf7-c6f3-4069-95d4-2069d15552a6 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
32992025-03-25T22:01:58.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5138edf7-c6f3-4069-95d4-2069d15552a6 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
33002025-03-25T22:01:58.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2098 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5138edf7-c6f3-4069-95d4-2069d15552a6 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
33012025-03-25T22:01:58.565ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:60301
33022025-03-25T22:01:58.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60301 req_id = c07e57d2-a4ad-4a26-9bee-56509345a249 roles = RoleSet { roles: {} } uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
33032025-03-25T22:01:58.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60301 req_id = c07e57d2-a4ad-4a26-9bee-56509345a249 resource = Database result = Ok(()) uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
33042025-03-25T22:01:58.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2860 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60301 req_id = c07e57d2-a4ad-4a26-9bee-56509345a249 response_code = 200 uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
33052025-03-25T22:01:58.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60301 req_id = aa4dc43f-fb57-4eb9-9be1-2ae1fdeb3b20 roles = RoleSet { roles: {} } uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
33062025-03-25T22:01:58.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60301 req_id = aa4dc43f-fb57-4eb9-9be1-2ae1fdeb3b20 resource = Database result = Ok(()) uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
33072025-03-25T22:01:58.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2459 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60301 req_id = aa4dc43f-fb57-4eb9-9be1-2ae1fdeb3b20 response_code = 200 uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
33082025-03-25T22:01:58.572ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 461 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = fdf71b72-61b7-4c8d-adb4-34a648dbedcd response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
33092025-03-25T22:01:59.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 38feeac2-d883-4028-bbc5-b283d300757e roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
33102025-03-25T22:01:59.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 38feeac2-d883-4028-bbc5-b283d300757e resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
33112025-03-25T22:01:59.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2057 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 38feeac2-d883-4028-bbc5-b283d300757e response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
33122025-03-25T22:02:00.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1ecd38be-b35f-48f4-a8e6-ea94d445c9b9 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
33132025-03-25T22:02:00.242ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1ecd38be-b35f-48f4-a8e6-ea94d445c9b9 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
33142025-03-25T22:02:00.244ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2177 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1ecd38be-b35f-48f4-a8e6-ea94d445c9b9 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
33152025-03-25T22:02:00.842ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 11 reason = Timeout
33162025-03-25T22:02:00.842ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33172025-03-25T22:02:00.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33182025-03-25T22:02:00.843ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 11 reason = Timeout
33192025-03-25T22:02:00.843ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33202025-03-25T22:02:00.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33212025-03-25T22:02:00.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33222025-03-25T22:02:00.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
33232025-03-25T22:02:00.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33242025-03-25T22:02:00.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33252025-03-25T22:02:00.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33262025-03-25T22:02:00.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33272025-03-25T22:02:00.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33282025-03-25T22:02:00.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
33292025-03-25T22:02:00.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33302025-03-25T22:02:00.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33312025-03-25T22:02:00.863ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
33322025-03-25T22:02:00.863ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.893905ms iteration = 11 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
33332025-03-25T22:02:00.874ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33342025-03-25T22:02:00.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33352025-03-25T22:02:00.904ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.418665ms iteration = 11 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
33362025-03-25T22:02:01.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 569d4843-87eb-4c8f-bf57-dcccb650c7c1 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
33372025-03-25T22:02:01.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 569d4843-87eb-4c8f-bf57-dcccb650c7c1 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
33382025-03-25T22:02:01.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1674 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 569d4843-87eb-4c8f-bf57-dcccb650c7c1 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
33392025-03-25T22:02:02.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 27d47793-0196-4bce-9584-124f8c21881a roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
33402025-03-25T22:02:02.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 27d47793-0196-4bce-9584-124f8c21881a resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
33412025-03-25T22:02:02.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2458 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 27d47793-0196-4bce-9584-124f8c21881a response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
33422025-03-25T22:02:03.306ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 427759c6-f8db-450b-98a9-856c0d66805b roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
33432025-03-25T22:02:03.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 427759c6-f8db-450b-98a9-856c0d66805b resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
33442025-03-25T22:02:03.308ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2673 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 427759c6-f8db-450b-98a9-856c0d66805b response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
33452025-03-25T22:02:04.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e255c1bc-858f-4e44-9be3-e347a429ccb2 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
33462025-03-25T22:02:04.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e255c1bc-858f-4e44-9be3-e347a429ccb2 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
33472025-03-25T22:02:04.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1940 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e255c1bc-858f-4e44-9be3-e347a429ccb2 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
33482025-03-25T22:02:05.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2830e5e0-8be4-427c-972c-5595e192e597 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
33492025-03-25T22:02:05.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2830e5e0-8be4-427c-972c-5595e192e597 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
33502025-03-25T22:02:05.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2607 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2830e5e0-8be4-427c-972c-5595e192e597 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
33512025-03-25T22:02:06.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a1fcc4b2-97e0-4868-a173-aaab90f63b07 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
33522025-03-25T22:02:06.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a1fcc4b2-97e0-4868-a173-aaab90f63b07 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
33532025-03-25T22:02:06.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2245 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a1fcc4b2-97e0-4868-a173-aaab90f63b07 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
33542025-03-25T22:02:07.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0c9f14a1-754d-4a6d-82b3-2e8058a9213a roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
33552025-03-25T22:02:07.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0c9f14a1-754d-4a6d-82b3-2e8058a9213a resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
33562025-03-25T22:02:07.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2518 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0c9f14a1-754d-4a6d-82b3-2e8058a9213a response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
33572025-03-25T22:02:08.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 648474df-8d9d-40bd-9472-9f07b0999420 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
33582025-03-25T22:02:08.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 648474df-8d9d-40bd-9472-9f07b0999420 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
33592025-03-25T22:02:08.421ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1904 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 648474df-8d9d-40bd-9472-9f07b0999420 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
33602025-03-25T22:02:08.573ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 918 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = d35cba6e-c027-4946-a221-dd98b1952357 response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
33612025-03-25T22:02:09.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = fab3e562-d9aa-40f6-8214-9f539b7921f5 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
33622025-03-25T22:02:09.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = fab3e562-d9aa-40f6-8214-9f539b7921f5 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
33632025-03-25T22:02:09.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2088 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = fab3e562-d9aa-40f6-8214-9f539b7921f5 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
33642025-03-25T22:02:10.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f32053e7-4015-4ea8-9f62-480e97235961 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
33652025-03-25T22:02:10.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f32053e7-4015-4ea8-9f62-480e97235961 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
33662025-03-25T22:02:10.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2483 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f32053e7-4015-4ea8-9f62-480e97235961 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
33672025-03-25T22:02:10.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 12 reason = Timeout
33682025-03-25T22:02:10.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33692025-03-25T22:02:10.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33702025-03-25T22:02:10.843ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 12 reason = Timeout
33712025-03-25T22:02:10.843ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33722025-03-25T22:02:10.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33732025-03-25T22:02:10.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33742025-03-25T22:02:10.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
33752025-03-25T22:02:10.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33762025-03-25T22:02:10.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33772025-03-25T22:02:10.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33782025-03-25T22:02:10.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33792025-03-25T22:02:10.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33802025-03-25T22:02:10.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
33812025-03-25T22:02:10.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33822025-03-25T22:02:10.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33832025-03-25T22:02:10.864ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
33842025-03-25T22:02:10.864ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.279802ms iteration = 12 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
33852025-03-25T22:02:10.872ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33862025-03-25T22:02:10.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33872025-03-25T22:02:10.874ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.269348ms iteration = 12 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
33882025-03-25T22:02:11.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b7dbef32-b760-452d-aa02-43e00fccb354 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
33892025-03-25T22:02:11.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b7dbef32-b760-452d-aa02-43e00fccb354 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
33902025-03-25T22:02:11.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2362 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b7dbef32-b760-452d-aa02-43e00fccb354 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
33912025-03-25T22:02:12.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3c7f3ec7-a947-4498-bad8-bc4788ba8e67 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
33922025-03-25T22:02:12.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3c7f3ec7-a947-4498-bad8-bc4788ba8e67 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
33932025-03-25T22:02:12.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1995 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3c7f3ec7-a947-4498-bad8-bc4788ba8e67 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
33942025-03-25T22:02:13.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 43039a82-d970-43b2-a4e3-52b792646e3c roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
33952025-03-25T22:02:13.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 43039a82-d970-43b2-a4e3-52b792646e3c resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
33962025-03-25T22:02:13.531ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2404 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 43039a82-d970-43b2-a4e3-52b792646e3c response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
33972025-03-25T22:02:14.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 078c9826-f841-444f-9792-4f3bb33f504b roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
33982025-03-25T22:02:14.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 078c9826-f841-444f-9792-4f3bb33f504b resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
33992025-03-25T22:02:14.554ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2697 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 078c9826-f841-444f-9792-4f3bb33f504b response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
34002025-03-25T22:02:15.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d90e210b-2b4b-4a1e-bcf8-526ac91e1370 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
34012025-03-25T22:02:15.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d90e210b-2b4b-4a1e-bcf8-526ac91e1370 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
34022025-03-25T22:02:15.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1875 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d90e210b-2b4b-4a1e-bcf8-526ac91e1370 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
34032025-03-25T22:02:16.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 858b8edf-1d43-47a5-a6f4-5b0e16464e23 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
34042025-03-25T22:02:16.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 858b8edf-1d43-47a5-a6f4-5b0e16464e23 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
34052025-03-25T22:02:16.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2388 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 858b8edf-1d43-47a5-a6f4-5b0e16464e23 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
34062025-03-25T22:02:17.618ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 70568d63-dbd7-45ad-bdc0-eebc7133c573 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
34072025-03-25T22:02:17.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 70568d63-dbd7-45ad-bdc0-eebc7133c573 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
34082025-03-25T22:02:17.621ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2379 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 70568d63-dbd7-45ad-bdc0-eebc7133c573 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
34092025-03-25T22:02:18.572ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 539 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = d08ddc7d-e8c1-48f4-b8b3-afe4494f8302 response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
34102025-03-25T22:02:18.641ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 29ffcb90-df4b-41c9-8355-df65d2e9b7cd roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
34112025-03-25T22:02:18.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 29ffcb90-df4b-41c9-8355-df65d2e9b7cd resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
34122025-03-25T22:02:18.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2115 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 29ffcb90-df4b-41c9-8355-df65d2e9b7cd response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
34132025-03-25T22:02:19.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0261aa0a-5ae3-4701-a3f7-4707529bbae8 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
34142025-03-25T22:02:19.663ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0261aa0a-5ae3-4701-a3f7-4707529bbae8 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
34152025-03-25T22:02:19.665ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2433 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0261aa0a-5ae3-4701-a3f7-4707529bbae8 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
34162025-03-25T22:02:20.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f1be1b03-2193-4669-a650-9dad479a59a6 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
34172025-03-25T22:02:20.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f1be1b03-2193-4669-a650-9dad479a59a6 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
34182025-03-25T22:02:20.687ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1636 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f1be1b03-2193-4669-a650-9dad479a59a6 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
34192025-03-25T22:02:20.842ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 5 reason = Timeout
34202025-03-25T22:02:20.842ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
34212025-03-25T22:02:20.842ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 3 reason = Timeout
34222025-03-25T22:02:20.842ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 5 reason = Timeout
34232025-03-25T22:02:20.842ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
34242025-03-25T22:02:20.842ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 5 reason = Timeout
34252025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
34262025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 5 reason = Timeout
34272025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34282025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
34292025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 5 reason = Timeout
34302025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 13 reason = Timeout
34312025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
34322025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34332025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 3 reason = Timeout
34342025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 3 reason = Timeout
34352025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
34362025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34372025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 3 reason = Timeout
34382025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34392025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 3 reason = Timeout
34402025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
34412025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34422025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 5 reason = Timeout
34432025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
34442025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 4 reason = Timeout
34452025-03-25T22:02:20.843ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:82 reason = blueprint disabled target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7
34462025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.361\u{b5}s iteration = 4 status = {"enabled":false,"target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7"}
34472025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 7 reason = Timeout
34482025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 5 reason = Timeout
34492025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34502025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 3 reason = Timeout
34512025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 5 reason = Timeout
34522025-03-25T22:02:20.843ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-03-25 21:52:20.843103238 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
34532025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
34542025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 5 reason = Timeout
34552025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34562025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 5 reason = Timeout
34572025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34582025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 3 reason = Timeout
34592025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34602025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
34612025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34622025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
34632025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34642025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
34652025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34662025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34672025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34682025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
34692025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
34702025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
34712025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 5 reason = Timeout
34722025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34732025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
34742025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 5 reason = Timeout
34752025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 5 reason = Timeout
34762025-03-25T22:02:20.843ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
34772025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 5 reason = Timeout
34782025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
34792025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
34802025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34812025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
34822025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 3 reason = Timeout
34832025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
34842025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 5 reason = Timeout
34852025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
34862025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 3 reason = Timeout
34872025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
34882025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 5 reason = Timeout
34892025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34902025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
34912025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 3 reason = Timeout
34922025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 5 reason = Timeout
34932025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
34942025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 13 reason = Timeout
34952025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
34962025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34972025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 5 reason = Timeout
34982025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
34992025-03-25T22:02:20.843ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5533f428-2028-4269-b7b1-f15912c01133.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("66b022b6-2e12-413e-b4b7-56c4ad5bdd77.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f337d25b-c67a-4a32-89e1-e187aea97ed9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f337d25b-c67a-4a32-89e1-e187aea97ed9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 6294, tv_nsec: 180485691 } })
35002025-03-25T22:02:20.843ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("58d382a7-99da-40a7-bc9f-2da7e9b156c1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d42076c6-06fe-4102-a978-c7d0a8dffb98.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d42076c6-06fe-4102-a978-c7d0a8dffb98.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 6294, tv_nsec: 180549132 } })
35012025-03-25T22:02:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35022025-03-25T22:02:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35032025-03-25T22:02:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35042025-03-25T22:02:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
35052025-03-25T22:02:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
35062025-03-25T22:02:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
35072025-03-25T22:02:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35082025-03-25T22:02:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
35092025-03-25T22:02:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
35102025-03-25T22:02:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
35112025-03-25T22:02:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
35122025-03-25T22:02:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
35132025-03-25T22:02:20.844ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
35142025-03-25T22:02:20.844ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.376134ms iteration = 3 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
35152025-03-25T22:02:20.844ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
35162025-03-25T22:02:20.844ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.581428ms iteration = 3 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
35172025-03-25T22:02:20.844ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35182025-03-25T22:02:20.845ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35192025-03-25T22:02:20.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35202025-03-25T22:02:20.846ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.071121ms iteration = 5 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
35212025-03-25T22:02:20.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
35222025-03-25T22:02:20.847ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35232025-03-25T22:02:20.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35242025-03-25T22:02:20.847ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6294, tv_nsec: 184210406 } })
35252025-03-25T22:02:20.847ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1171
35262025-03-25T22:02:20.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
35272025-03-25T22:02:20.848ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
35282025-03-25T22:02:20.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
35292025-03-25T22:02:20.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
35302025-03-25T22:02:20.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35312025-03-25T22:02:20.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35322025-03-25T22:02:20.849ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6294, tv_nsec: 185888986 } })
35332025-03-25T22:02:20.849ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1171
35342025-03-25T22:02:20.849ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35352025-03-25T22:02:20.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35362025-03-25T22:02:20.850ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35372025-03-25T22:02:20.850ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35382025-03-25T22:02:20.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35392025-03-25T22:02:20.851ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35402025-03-25T22:02:20.851ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
35412025-03-25T22:02:20.851ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35422025-03-25T22:02:20.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35432025-03-25T22:02:20.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
35442025-03-25T22:02:20.853ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
35452025-03-25T22:02:20.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
35462025-03-25T22:02:20.854ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35472025-03-25T22:02:20.854ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-03-25 21:52:20.843103238 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
35482025-03-25T22:02:20.854ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 11.501891ms iteration = 3 status = {"expiration":"2025-03-25T21:52:20.843103238Z","pruned":[]}
35492025-03-25T22:02:20.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
35502025-03-25T22:02:20.857ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35512025-03-25T22:02:20.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35522025-03-25T22:02:20.860ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 16.987507ms iteration = 3 status = {"errors":[],"found_port_ok":[]}
35532025-03-25T22:02:20.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35542025-03-25T22:02:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35552025-03-25T22:02:20.862ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
35562025-03-25T22:02:20.862ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
35572025-03-25T22:02:20.862ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 18.497243ms iteration = 3 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
35582025-03-25T22:02:20.862ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35592025-03-25T22:02:20.864ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 20.752633ms iteration = 5 status = {"errors":[],"requests_created_ok":[]}
35602025-03-25T22:02:20.865ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6294, tv_nsec: 202397944 } })
35612025-03-25T22:02:20.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
35622025-03-25T22:02:20.865ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
35632025-03-25T22:02:20.866ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1171 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
35642025-03-25T22:02:20.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
35652025-03-25T22:02:20.871ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35662025-03-25T22:02:20.871ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35672025-03-25T22:02:20.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35682025-03-25T22:02:20.872ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35692025-03-25T22:02:20.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35702025-03-25T22:02:20.875ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
35712025-03-25T22:02:20.879ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35722025-03-25T22:02:20.884ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
35732025-03-25T22:02:20.884ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35742025-03-25T22:02:20.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35752025-03-25T22:02:20.886ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35762025-03-25T22:02:20.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35772025-03-25T22:02:20.888ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35782025-03-25T22:02:20.891ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
35792025-03-25T22:02:20.891ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35802025-03-25T22:02:20.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35812025-03-25T22:02:20.914ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35822025-03-25T22:02:20.917ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
35832025-03-25T22:02:20.917ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35842025-03-25T22:02:20.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35852025-03-25T22:02:20.921ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35862025-03-25T22:02:20.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35872025-03-25T22:02:20.924ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
35882025-03-25T22:02:20.924ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
35892025-03-25T22:02:20.924ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 81.930631ms iteration = 13 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
35902025-03-25T22:02:20.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
35912025-03-25T22:02:20.928ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35922025-03-25T22:02:20.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35932025-03-25T22:02:20.928ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35942025-03-25T22:02:20.928ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
35952025-03-25T22:02:20.928ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35962025-03-25T22:02:20.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35972025-03-25T22:02:20.929ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 85.8683ms iteration = 5 status = {"errors":[],"finish_invoked_ok":[]}
35982025-03-25T22:02:20.929ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 86.706555ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
35992025-03-25T22:02:20.930ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36002025-03-25T22:02:20.931ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36012025-03-25T22:02:20.931ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
36022025-03-25T22:02:20.931ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36032025-03-25T22:02:20.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36042025-03-25T22:02:20.932ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36052025-03-25T22:02:20.934ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
36062025-03-25T22:02:20.934ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
36072025-03-25T22:02:20.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
36082025-03-25T22:02:20.934ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36092025-03-25T22:02:20.935ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
36102025-03-25T22:02:20.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
36112025-03-25T22:02:20.937ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
36122025-03-25T22:02:20.938ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
36132025-03-25T22:02:20.938ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36142025-03-25T22:02:20.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36152025-03-25T22:02:20.939ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
36162025-03-25T22:02:20.939ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
36172025-03-25T22:02:20.939ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
36182025-03-25T22:02:20.939ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36192025-03-25T22:02:20.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36202025-03-25T22:02:20.940ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36212025-03-25T22:02:20.941ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36222025-03-25T22:02:20.943ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
36232025-03-25T22:02:20.943ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36242025-03-25T22:02:20.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36252025-03-25T22:02:20.946ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
36262025-03-25T22:02:20.947ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36272025-03-25T22:02:20.947ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
36282025-03-25T22:02:20.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36292025-03-25T22:02:20.947ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 103.595159ms iteration = 5 status = {"errors":[],"garbage_collect_requested":[]}
36302025-03-25T22:02:20.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
36312025-03-25T22:02:20.948ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 104.459335ms iteration = 13 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36322025-03-25T22:02:20.953ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
36332025-03-25T22:02:20.953ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
36342025-03-25T22:02:20.953ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
36352025-03-25T22:02:20.953ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
36362025-03-25T22:02:20.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
36372025-03-25T22:02:20.954ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
36382025-03-25T22:02:20.954ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
36392025-03-25T22:02:20.954ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 111.367385ms iteration = 3 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
36402025-03-25T22:02:20.955ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
36412025-03-25T22:02:20.955ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 111.691821ms iteration = 5 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
36422025-03-25T22:02:20.955ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36432025-03-25T22:02:20.955ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36442025-03-25T22:02:20.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36452025-03-25T22:02:20.960ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36462025-03-25T22:02:20.960ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
36472025-03-25T22:02:20.960ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
36482025-03-25T22:02:20.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
36492025-03-25T22:02:20.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36502025-03-25T22:02:20.967ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
36512025-03-25T22:02:20.967ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36522025-03-25T22:02:20.968ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d181d011-4445-4dfb-9a28-ef3192573c92", "content-length": "26", "date": "Tue, 25 Mar 2025 22:02:20 GMT"} })
36532025-03-25T22:02:20.968ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36542025-03-25T22:02:20.969ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36552025-03-25T22:02:20.971ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36562025-03-25T22:02:20.974ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
36572025-03-25T22:02:20.974ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 96679ce4-e18c-487b-803a-7b26be55e85c dns_zone_name = oxide.test found_so_far = 0 version = 2
36582025-03-25T22:02:20.974ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
36592025-03-25T22:02:20.974ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f034aaf6-2037-4cb4-8409-3ab31c15cc28, lookup_type: ById(f034aaf6-2037-4cb4-8409-3ab31c15cc28) } result = Ok(())
36602025-03-25T22:02:20.974ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36612025-03-25T22:02:20.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
36622025-03-25T22:02:20.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36632025-03-25T22:02:20.976ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36642025-03-25T22:02:20.978ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 134.909186ms iteration = 5 status = 0
36652025-03-25T22:02:20.979ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
36662025-03-25T22:02:20.979ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
36672025-03-25T22:02:20.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
36682025-03-25T22:02:20.981ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
36692025-03-25T22:02:20.982ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 96679ce4-e18c-487b-803a-7b26be55e85c dns_zone_name = oxide.test found_so_far = 1 version = 2
36702025-03-25T22:02:20.982ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
36712025-03-25T22:02:20.982ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-03-25 22:00:22.561696 UTC dns_group = external generation = 2
36722025-03-25T22:02:20.982ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 139.482207ms iteration = 3 status = {"generation":2}
36732025-03-25T22:02:20.984ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36742025-03-25T22:02:20.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36752025-03-25T22:02:20.988ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
36762025-03-25T22:02:20.988ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36772025-03-25T22:02:20.988ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ee4f773-c513-4290-9a6b-469232d8a259", "content-length": "26", "date": "Tue, 25 Mar 2025 22:02:20 GMT"} })
36782025-03-25T22:02:20.988ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36792025-03-25T22:02:20.990ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36802025-03-25T22:02:20.994ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
36812025-03-25T22:02:20.997ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 153.739666ms iteration = 5 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
36822025-03-25T22:02:21.001ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36832025-03-25T22:02:21.004ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
36842025-03-25T22:02:21.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
36852025-03-25T22:02:21.005ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
36862025-03-25T22:02:21.005ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
36872025-03-25T22:02:21.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
36882025-03-25T22:02:21.007ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36892025-03-25T22:02:21.008ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 164.991603ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
36902025-03-25T22:02:21.009ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
36912025-03-25T22:02:21.009ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
36922025-03-25T22:02:21.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
36932025-03-25T22:02:21.010ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
36942025-03-25T22:02:21.010ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 23d93905-7b89-4296-b050-7ff9ae235c15 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
36952025-03-25T22:02:21.010ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36962025-03-25T22:02:21.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36972025-03-25T22:02:21.012ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36982025-03-25T22:02:21.013ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
36992025-03-25T22:02:21.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
37002025-03-25T22:02:21.015ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
37012025-03-25T22:02:21.015ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
37022025-03-25T22:02:21.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
37032025-03-25T22:02:21.016ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
37042025-03-25T22:02:21.016ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
37052025-03-25T22:02:21.016ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 172.86484ms iteration = 5 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
37062025-03-25T22:02:21.023ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37072025-03-25T22:02:21.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37082025-03-25T22:02:21.024ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 23d93905-7b89-4296-b050-7ff9ae235c15 dns_zone_name = control-plane.oxide.internal found_so_far = 52 version = 1
37092025-03-25T22:02:21.024ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
37102025-03-25T22:02:21.024ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-03-25 22:00:21.368103 UTC dns_group = internal generation = 1
37112025-03-25T22:02:21.024ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 181.255386ms iteration = 3 status = {"generation":1}
37122025-03-25T22:02:21.033ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 zone_address = fd00:1122:3344:101::2
37132025-03-25T22:02:21.033ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37142025-03-25T22:02:21.033ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bcf4b1fc-d9f8-49ff-9308-cc4a5e710e26", "content-length": "26", "date": "Tue, 25 Mar 2025 22:02:20 GMT"} })
37152025-03-25T22:02:21.033ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1184 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37162025-03-25T22:02:21.039ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
37172025-03-25T22:02:21.061ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-03-25T22:00:16.382271Z, time_modified: 2025-03-25T22:00:16.382271Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, db_silo: Silo { identity: SiloIdentity { id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-25T22:00:22.501108Z, time_modified: 2025-03-25T22:00:22.501108Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, db_silo: Silo { identity: SiloIdentity { id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-25T22:00:22.501108Z, time_modified: 2025-03-25T22:00:22.501108Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d" }] }) }
37182025-03-25T22:02:21.064ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 221.139023ms iteration = 3 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"5c35ff8c-21dd-48b9-9751-76bfa681bc38","tls_certs":["0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d"]}},"default_endpoint":{"silo_id":"5c35ff8c-21dd-48b9-9751-76bfa681bc38","tls_certs":["0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
37192025-03-25T22:02:21.064ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:360
37202025-03-25T22:02:21.064ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 221.753274ms iteration = 5 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
37212025-03-25T22:02:21.086ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37222025-03-25T22:02:21.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37232025-03-25T22:02:21.089ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37242025-03-25T22:02:21.091ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37252025-03-25T22:02:21.091ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37262025-03-25T22:02:21.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37272025-03-25T22:02:21.094ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37282025-03-25T22:02:21.096ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37292025-03-25T22:02:21.096ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37302025-03-25T22:02:21.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37312025-03-25T22:02:21.111ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 268.46622ms iteration = 7 status = {"physical_disks_added":0}
37322025-03-25T22:02:21.144ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 301.461217ms iteration = 5 status = {}
37332025-03-25T22:02:21.174ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
37342025-03-25T22:02:21.174ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 330.487063ms iteration = 3 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
37352025-03-25T22:02:21.180ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
37362025-03-25T22:02:21.181ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "0761eab8-2fa7-497c-abeb-1fc38777fa21", "date": "Tue, 25 Mar 2025 22:02:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
37372025-03-25T22:02:21.181ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
37382025-03-25T22:02:21.182ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "c2c55e42-2470-49d8-9ee8-d306f3e25dfb", "date": "Tue, 25 Mar 2025 22:02:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
37392025-03-25T22:02:21.182ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
37402025-03-25T22:02:21.184ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
37412025-03-25T22:02:21.184ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 341.567627ms iteration = 5 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
37422025-03-25T22:02:21.202ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
37432025-03-25T22:02:21.202ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37442025-03-25T22:02:21.203ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a4f1ca46-9cf5-4a48-8ad4-38409d97c42b", "content-length": "372", "date": "Tue, 25 Mar 2025 22:02:21 GMT"} })
37452025-03-25T22:02:21.203ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37462025-03-25T22:02:21.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37472025-03-25T22:02:21.237ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
37482025-03-25T22:02:21.237ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6096267c-9c90-4920-a280-54c943387a6a", "content-length": "1", "date": "Tue, 25 Mar 2025 22:02:21 GMT"} })
37492025-03-25T22:02:21.238ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
37502025-03-25T22:02:21.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
37512025-03-25T22:02:21.241ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 398.924449ms iteration = 5 status = null
37522025-03-25T22:02:21.243ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
37532025-03-25T22:02:21.249ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
37542025-03-25T22:02:21.249ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
37552025-03-25T22:02:21.249ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "73300d1a-7bbd-4e39-b04d-ad9f69811c38", "date": "Tue, 25 Mar 2025 22:02:21 GMT"} })
37562025-03-25T22:02:21.249ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37572025-03-25T22:02:21.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37582025-03-25T22:02:21.252ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37592025-03-25T22:02:21.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37602025-03-25T22:02:21.287ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
37612025-03-25T22:02:21.287ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d29e9ba-ad6f-482a-b5b5-cf61797be41b", "content-length": "691", "date": "Tue, 25 Mar 2025 22:02:21 GMT"} })
37622025-03-25T22:02:21.287ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
37632025-03-25T22:02:21.287ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
37642025-03-25T22:02:21.287ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
37652025-03-25T22:02:21.289ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 446.132483ms iteration = 5 status = {}
37662025-03-25T22:02:21.290ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37672025-03-25T22:02:21.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37682025-03-25T22:02:21.293ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
37692025-03-25T22:02:21.293ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37702025-03-25T22:02:21.294ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "25945b0c-9563-4518-99fa-cbb527f353ba", "date": "Tue, 25 Mar 2025 22:02:21 GMT"} })
37712025-03-25T22:02:21.295ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 451.705091ms iteration = 5 status = {}
37722025-03-25T22:02:21.314ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
37732025-03-25T22:02:21.314ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "5f4e7661-1e04-4ae5-8151-0d7e139a48a5", "date": "Tue, 25 Mar 2025 22:02:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
37742025-03-25T22:02:21.314ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
37752025-03-25T22:02:21.316ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "c85486c9-da6c-46c5-82a3-55d25e3fdfd0", "date": "Tue, 25 Mar 2025 22:02:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
37762025-03-25T22:02:21.316ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
37772025-03-25T22:02:21.317ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "13a0503f-795a-4d98-9f84-9bfdd9c62e27", "date": "Tue, 25 Mar 2025 22:02:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
37782025-03-25T22:02:21.317ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
37792025-03-25T22:02:21.318ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
37802025-03-25T22:02:21.318ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 475.499637ms iteration = 5 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
37812025-03-25T22:02:21.329ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37822025-03-25T22:02:21.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37832025-03-25T22:02:21.331ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a5db250-fa3f-4168-ab16-5c36568c22e2, rack_id: c7210e4b-5a81-4ec8-b8fe-816a9508dc74, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(6d5dda50-e3c4-4853-9bfa-a66b447ab351) } rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
37842025-03-25T22:02:21.331ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37852025-03-25T22:02:21.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37862025-03-25T22:02:21.341ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
37872025-03-25T22:02:21.341ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d7ea1500-6cf6-4946-81e5-69e57b870845", "content-length": "134", "date": "Tue, 25 Mar 2025 22:02:21 GMT"} })
37882025-03-25T22:02:21.341ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
37892025-03-25T22:02:21.342ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 6d5dda50-e3c4-4853-9bfa-a66b447ab351
37902025-03-25T22:02:21.342ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
37912025-03-25T22:02:21.342ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
37922025-03-25T22:02:21.342ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37932025-03-25T22:02:21.342ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37942025-03-25T22:02:21.342ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37952025-03-25T22:02:21.342ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
37962025-03-25T22:02:21.342ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37972025-03-25T22:02:21.342ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
37982025-03-25T22:02:21.342ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
37992025-03-25T22:02:21.342ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38002025-03-25T22:02:21.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38012025-03-25T22:02:21.345ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
38022025-03-25T22:02:21.345ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "6749f5ee-e7a3-49e6-8c11-7da07216ce2b", "content-length": "2", "date": "Tue, 25 Mar 2025 22:02:21 GMT"} })
38032025-03-25T22:02:21.345ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
38042025-03-25T22:02:21.345ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6cdb48cd-d5e6-4323-b4a8-48d118f900e4", "content-length": "52", "date": "Tue, 25 Mar 2025 22:02:21 GMT"} })
38052025-03-25T22:02:21.345ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
38062025-03-25T22:02:21.345ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
38072025-03-25T22:02:21.440ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "5a506945-096e-4ed7-8d2b-e21bf53c3147", "date": "Tue, 25 Mar 2025 22:02:21 GMT"} })
38082025-03-25T22:02:21.440ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch = Switch0
38092025-03-25T22:02:21.440ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
38102025-03-25T22:02:21.440ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "690ba8b3-b978-411f-93e9-a8aa01a967cf", "content-length": "682", "date": "Tue, 25 Mar 2025 22:02:21 GMT"} })
38112025-03-25T22:02:21.440ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38122025-03-25T22:02:21.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38132025-03-25T22:02:21.445ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38142025-03-25T22:02:21.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38152025-03-25T22:02:21.448ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38162025-03-25T22:02:21.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38172025-03-25T22:02:21.450ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38182025-03-25T22:02:21.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38192025-03-25T22:02:21.458ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 615.38018ms iteration = 5 status = {}
38202025-03-25T22:02:21.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e28010f7-3ffd-48ed-946c-05b2f51ed56a roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38212025-03-25T22:02:21.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e28010f7-3ffd-48ed-946c-05b2f51ed56a resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38222025-03-25T22:02:21.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1988 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e28010f7-3ffd-48ed-946c-05b2f51ed56a response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38232025-03-25T22:02:22.778ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a8d67ea3-6026-4582-b236-e8036860c02c roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38242025-03-25T22:02:22.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a8d67ea3-6026-4582-b236-e8036860c02c resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38252025-03-25T22:02:22.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2485 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a8d67ea3-6026-4582-b236-e8036860c02c response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38262025-03-25T22:02:23.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 91e16db8-6215-4acb-9f56-1f387596b563 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38272025-03-25T22:02:23.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 91e16db8-6215-4acb-9f56-1f387596b563 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38282025-03-25T22:02:23.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2326 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 91e16db8-6215-4acb-9f56-1f387596b563 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38292025-03-25T22:02:24.823ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 993c4184-d116-4a57-93a8-d14b7c7bad82 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38302025-03-25T22:02:24.823ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 993c4184-d116-4a57-93a8-d14b7c7bad82 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38312025-03-25T22:02:24.825ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2113 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 993c4184-d116-4a57-93a8-d14b7c7bad82 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38322025-03-25T22:02:25.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7f5bf3c4-3f67-4c67-8103-06debd9e6957 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38332025-03-25T22:02:25.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7f5bf3c4-3f67-4c67-8103-06debd9e6957 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38342025-03-25T22:02:25.848ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2276 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7f5bf3c4-3f67-4c67-8103-06debd9e6957 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38352025-03-25T22:02:26.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f4033691-84ee-484b-932c-736f6460d344 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38362025-03-25T22:02:26.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f4033691-84ee-484b-932c-736f6460d344 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38372025-03-25T22:02:26.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2314 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f4033691-84ee-484b-932c-736f6460d344 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38382025-03-25T22:02:27.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d704d4a4-60b9-4b07-87c2-02601773bffa roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38392025-03-25T22:02:27.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d704d4a4-60b9-4b07-87c2-02601773bffa resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38402025-03-25T22:02:27.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2022 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d704d4a4-60b9-4b07-87c2-02601773bffa response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38412025-03-25T22:02:28.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60301 req_id = b9e1028c-20e8-4841-aa98-374861350bd9 roles = RoleSet { roles: {} } uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
38422025-03-25T22:02:28.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60301 req_id = b9e1028c-20e8-4841-aa98-374861350bd9 resource = Database result = Ok(()) uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
38432025-03-25T22:02:28.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2596 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60301 req_id = b9e1028c-20e8-4841-aa98-374861350bd9 response_code = 200 uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
38442025-03-25T22:02:28.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60301 req_id = 43300e9b-2a0c-4122-9f6d-17e22728a331 roles = RoleSet { roles: {} } uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
38452025-03-25T22:02:28.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60301 req_id = 43300e9b-2a0c-4122-9f6d-17e22728a331 resource = Database result = Ok(()) uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
38462025-03-25T22:02:28.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2783 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60301 req_id = 43300e9b-2a0c-4122-9f6d-17e22728a331 response_code = 200 uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
38472025-03-25T22:02:28.572ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 529 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = 277db7ef-eed0-4181-8a72-880f7ead02a5 response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
38482025-03-25T22:02:28.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0697327f-bc3e-49bf-a535-18aba7ae8d1b roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38492025-03-25T22:02:28.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0697327f-bc3e-49bf-a535-18aba7ae8d1b resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38502025-03-25T22:02:28.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2403 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0697327f-bc3e-49bf-a535-18aba7ae8d1b response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38512025-03-25T22:02:29.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d605a63a-4f72-4eff-8fa5-9cfcd22c642c roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38522025-03-25T22:02:29.932ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d605a63a-4f72-4eff-8fa5-9cfcd22c642c resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38532025-03-25T22:02:29.934ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2059 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d605a63a-4f72-4eff-8fa5-9cfcd22c642c response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38542025-03-25T22:02:30.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 14 reason = Timeout
38552025-03-25T22:02:30.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38562025-03-25T22:02:30.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38572025-03-25T22:02:30.843ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 14 reason = Timeout
38582025-03-25T22:02:30.843ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38592025-03-25T22:02:30.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38602025-03-25T22:02:30.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38612025-03-25T22:02:30.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38622025-03-25T22:02:30.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38632025-03-25T22:02:30.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38642025-03-25T22:02:30.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38652025-03-25T22:02:30.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38662025-03-25T22:02:30.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38672025-03-25T22:02:30.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
38682025-03-25T22:02:30.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38692025-03-25T22:02:30.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38702025-03-25T22:02:30.866ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
38712025-03-25T22:02:30.867ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.565182ms iteration = 14 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
38722025-03-25T22:02:30.880ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38732025-03-25T22:02:30.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38742025-03-25T22:02:30.882ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 38.376211ms iteration = 14 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38752025-03-25T22:02:30.952ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ab032d02-eef3-475a-9af4-486d4f1b2f4f roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38762025-03-25T22:02:30.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ab032d02-eef3-475a-9af4-486d4f1b2f4f resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38772025-03-25T22:02:30.954ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1824 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ab032d02-eef3-475a-9af4-486d4f1b2f4f response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38782025-03-25T22:02:31.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6c3402f0-6b67-4394-8ab6-9eb5f2a70a4d roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38792025-03-25T22:02:31.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6c3402f0-6b67-4394-8ab6-9eb5f2a70a4d resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38802025-03-25T22:02:31.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2123 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6c3402f0-6b67-4394-8ab6-9eb5f2a70a4d response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38812025-03-25T22:02:32.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3bd940ce-3200-4e52-81b4-457dde959a1f roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38822025-03-25T22:02:32.998ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3bd940ce-3200-4e52-81b4-457dde959a1f resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38832025-03-25T22:02:33.000ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2470 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3bd940ce-3200-4e52-81b4-457dde959a1f response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38842025-03-25T22:02:34.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5319f8b4-69b4-4160-9ccc-4e8c2fdb708b roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38852025-03-25T22:02:34.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5319f8b4-69b4-4160-9ccc-4e8c2fdb708b resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38862025-03-25T22:02:34.022ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1865 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5319f8b4-69b4-4160-9ccc-4e8c2fdb708b response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38872025-03-25T22:02:35.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4cd660bf-9321-4e76-ad3c-e82e30e11522 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38882025-03-25T22:02:35.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4cd660bf-9321-4e76-ad3c-e82e30e11522 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38892025-03-25T22:02:35.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2313 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4cd660bf-9321-4e76-ad3c-e82e30e11522 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38902025-03-25T22:02:36.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e214c37a-a9fc-482c-91ba-371fdb41fdbb roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38912025-03-25T22:02:36.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e214c37a-a9fc-482c-91ba-371fdb41fdbb resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38922025-03-25T22:02:36.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2278 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e214c37a-a9fc-482c-91ba-371fdb41fdbb response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38932025-03-25T22:02:37.085ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 84025b3d-ae10-4570-bd7d-11c06a18f1cb roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38942025-03-25T22:02:37.085ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 84025b3d-ae10-4570-bd7d-11c06a18f1cb resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38952025-03-25T22:02:37.087ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2230 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 84025b3d-ae10-4570-bd7d-11c06a18f1cb response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38962025-03-25T22:02:38.106ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 9c97535c-3b9a-40f8-971d-163ef3463b98 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38972025-03-25T22:02:38.106ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 9c97535c-3b9a-40f8-971d-163ef3463b98 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38982025-03-25T22:02:38.108ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2166 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 9c97535c-3b9a-40f8-971d-163ef3463b98 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
38992025-03-25T22:02:38.572ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 543 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = ff7902fc-2c48-480d-91b6-0cc5d7d92c19 response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
39002025-03-25T22:02:39.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 081bd2e9-ce9a-4c88-a8d6-407924908705 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
39012025-03-25T22:02:39.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 081bd2e9-ce9a-4c88-a8d6-407924908705 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
39022025-03-25T22:02:39.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2005 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 081bd2e9-ce9a-4c88-a8d6-407924908705 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
39032025-03-25T22:02:40.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2203fceb-2a1a-4c66-a13d-92771ee481e3 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
39042025-03-25T22:02:40.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2203fceb-2a1a-4c66-a13d-92771ee481e3 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
39052025-03-25T22:02:40.152ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2431 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2203fceb-2a1a-4c66-a13d-92771ee481e3 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
39062025-03-25T22:02:40.842ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 15 reason = Timeout
39072025-03-25T22:02:40.842ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39082025-03-25T22:02:40.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39092025-03-25T22:02:40.843ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 15 reason = Timeout
39102025-03-25T22:02:40.843ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39112025-03-25T22:02:40.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39122025-03-25T22:02:40.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39132025-03-25T22:02:40.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39142025-03-25T22:02:40.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39152025-03-25T22:02:40.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39162025-03-25T22:02:40.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39172025-03-25T22:02:40.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39182025-03-25T22:02:40.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39192025-03-25T22:02:40.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
39202025-03-25T22:02:40.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39212025-03-25T22:02:40.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39222025-03-25T22:02:40.860ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
39232025-03-25T22:02:40.860ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.178057ms iteration = 15 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
39242025-03-25T22:02:40.874ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39252025-03-25T22:02:40.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39262025-03-25T22:02:40.876ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.435647ms iteration = 15 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39272025-03-25T22:02:41.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 67bd9864-f3f9-4aad-89f2-04645d226579 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
39282025-03-25T22:02:41.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 67bd9864-f3f9-4aad-89f2-04645d226579 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
39292025-03-25T22:02:41.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1783 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 67bd9864-f3f9-4aad-89f2-04645d226579 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
39302025-03-25T22:02:42.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f3e34fcf-463b-4eaf-abf3-86b0dd3de776 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
39312025-03-25T22:02:42.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f3e34fcf-463b-4eaf-abf3-86b0dd3de776 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
39322025-03-25T22:02:42.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2697 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f3e34fcf-463b-4eaf-abf3-86b0dd3de776 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
39332025-03-25T22:02:43.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2b3cd4fd-9846-4936-b00e-dd065a7f7aa2 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
39342025-03-25T22:02:43.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2b3cd4fd-9846-4936-b00e-dd065a7f7aa2 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
39352025-03-25T22:02:43.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1875 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2b3cd4fd-9846-4936-b00e-dd065a7f7aa2 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
39362025-03-25T22:02:44.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 21de0027-c4d1-4c8f-8a98-371b9f4d83aa roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
39372025-03-25T22:02:44.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 21de0027-c4d1-4c8f-8a98-371b9f4d83aa resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
39382025-03-25T22:02:44.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1910 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 21de0027-c4d1-4c8f-8a98-371b9f4d83aa response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
39392025-03-25T22:02:45.259ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7618afb2-3864-4ffa-a6c6-6bf78411bd20 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
39402025-03-25T22:02:45.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7618afb2-3864-4ffa-a6c6-6bf78411bd20 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
39412025-03-25T22:02:45.261ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2039 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7618afb2-3864-4ffa-a6c6-6bf78411bd20 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
39422025-03-25T22:02:46.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0486b7d6-b16e-40c3-bc74-a1abc448f792 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
39432025-03-25T22:02:46.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0486b7d6-b16e-40c3-bc74-a1abc448f792 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
39442025-03-25T22:02:46.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2301 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0486b7d6-b16e-40c3-bc74-a1abc448f792 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
39452025-03-25T22:02:47.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 36858ac3-7300-48e8-af5e-58d9960d6916 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
39462025-03-25T22:02:47.303ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 36858ac3-7300-48e8-af5e-58d9960d6916 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
39472025-03-25T22:02:47.304ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2170 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 36858ac3-7300-48e8-af5e-58d9960d6916 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
39482025-03-25T22:02:48.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = be754d6d-e4bb-47c2-b2b2-6bb700a95040 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
39492025-03-25T22:02:48.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = be754d6d-e4bb-47c2-b2b2-6bb700a95040 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
39502025-03-25T22:02:48.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1948 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = be754d6d-e4bb-47c2-b2b2-6bb700a95040 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
39512025-03-25T22:02:48.572ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 839 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = cbc05a2d-45f3-4209-817b-cd10b6f95d4c response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
39522025-03-25T22:02:49.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = cfcc3cb9-f313-4850-a736-1bf784a699fd roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
39532025-03-25T22:02:49.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = cfcc3cb9-f313-4850-a736-1bf784a699fd resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
39542025-03-25T22:02:49.347ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2068 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = cfcc3cb9-f313-4850-a736-1bf784a699fd response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
39552025-03-25T22:02:50.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4b355afe-0a48-4432-9212-39258c6731a5 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
39562025-03-25T22:02:50.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4b355afe-0a48-4432-9212-39258c6731a5 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
39572025-03-25T22:02:50.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2260 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4b355afe-0a48-4432-9212-39258c6731a5 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
39582025-03-25T22:02:50.843ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
39592025-03-25T22:02:50.843ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
39602025-03-25T22:02:50.843ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
39612025-03-25T22:02:50.843ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
39622025-03-25T22:02:50.843ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39632025-03-25T22:02:50.843ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
39642025-03-25T22:02:50.843ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
39652025-03-25T22:02:50.843ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
39662025-03-25T22:02:50.843ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
39672025-03-25T22:02:50.843ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39682025-03-25T22:02:50.843ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39692025-03-25T22:02:50.843ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
39702025-03-25T22:02:50.843ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39712025-03-25T22:02:50.843ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 6 reason = Timeout
39722025-03-25T22:02:50.843ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
39732025-03-25T22:02:50.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
39742025-03-25T22:02:50.843ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 8 reason = Timeout
39752025-03-25T22:02:50.843ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39762025-03-25T22:02:50.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39772025-03-25T22:02:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39782025-03-25T22:02:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
39792025-03-25T22:02:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39802025-03-25T22:02:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39812025-03-25T22:02:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
39822025-03-25T22:02:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
39832025-03-25T22:02:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39842025-03-25T22:02:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39852025-03-25T22:02:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39862025-03-25T22:02:50.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 6 reason = Timeout
39872025-03-25T22:02:50.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
39882025-03-25T22:02:50.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39892025-03-25T22:02:50.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39902025-03-25T22:02:50.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
39912025-03-25T22:02:50.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
39922025-03-25T22:02:50.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
39932025-03-25T22:02:50.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
39942025-03-25T22:02:50.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 6 reason = Timeout
39952025-03-25T22:02:50.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
39962025-03-25T22:02:50.844ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
39972025-03-25T22:02:50.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39982025-03-25T22:02:50.844ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
39992025-03-25T22:02:50.844ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
40002025-03-25T22:02:50.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40012025-03-25T22:02:50.844ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 6 reason = Timeout
40022025-03-25T22:02:50.844ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
40032025-03-25T22:02:50.844ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 6 reason = Timeout
40042025-03-25T22:02:50.844ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
40052025-03-25T22:02:50.844ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40062025-03-25T22:02:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
40072025-03-25T22:02:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40082025-03-25T22:02:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
40092025-03-25T22:02:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
40102025-03-25T22:02:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40112025-03-25T22:02:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40122025-03-25T22:02:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40132025-03-25T22:02:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
40142025-03-25T22:02:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
40152025-03-25T22:02:50.845ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6324, tv_nsec: 182355924 } })
40162025-03-25T22:02:50.846ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1171
40172025-03-25T22:02:50.846ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40182025-03-25T22:02:50.847ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.662604ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
40192025-03-25T22:02:50.847ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40202025-03-25T22:02:50.847ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6324, tv_nsec: 184195656 } })
40212025-03-25T22:02:50.847ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40222025-03-25T22:02:50.847ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1171
40232025-03-25T22:02:50.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40242025-03-25T22:02:50.849ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40252025-03-25T22:02:50.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40262025-03-25T22:02:50.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
40272025-03-25T22:02:50.850ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
40282025-03-25T22:02:50.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
40292025-03-25T22:02:50.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
40302025-03-25T22:02:50.850ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40312025-03-25T22:02:50.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40322025-03-25T22:02:50.850ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40332025-03-25T22:02:50.851ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 7.462011ms iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
40342025-03-25T22:02:50.852ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40352025-03-25T22:02:50.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
40362025-03-25T22:02:50.852ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40372025-03-25T22:02:50.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40382025-03-25T22:02:50.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40392025-03-25T22:02:50.854ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40402025-03-25T22:02:50.854ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40412025-03-25T22:02:50.855ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 11.377549ms iteration = 6 status = {"errors":[],"finish_invoked_ok":[]}
40422025-03-25T22:02:50.855ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40432025-03-25T22:02:50.855ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
40442025-03-25T22:02:50.855ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40452025-03-25T22:02:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
40462025-03-25T22:02:50.856ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
40472025-03-25T22:02:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40482025-03-25T22:02:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
40492025-03-25T22:02:50.857ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40502025-03-25T22:02:50.857ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40512025-03-25T22:02:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40522025-03-25T22:02:50.860ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40532025-03-25T22:02:50.860ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 15.950109ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40542025-03-25T22:02:50.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40552025-03-25T22:02:50.860ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40562025-03-25T22:02:50.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40572025-03-25T22:02:50.863ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6324, tv_nsec: 199606925 } })
40582025-03-25T22:02:50.863ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1171 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
40592025-03-25T22:02:50.864ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40602025-03-25T22:02:50.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40612025-03-25T22:02:50.895ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40622025-03-25T22:02:50.895ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40632025-03-25T22:02:50.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40642025-03-25T22:02:50.895ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
40652025-03-25T22:02:50.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
40662025-03-25T22:02:50.897ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40672025-03-25T22:02:50.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40682025-03-25T22:02:50.898ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40692025-03-25T22:02:50.898ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40702025-03-25T22:02:50.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40712025-03-25T22:02:50.902ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 59.485739ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
40722025-03-25T22:02:50.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40732025-03-25T22:02:50.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40742025-03-25T22:02:50.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40752025-03-25T22:02:50.909ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40762025-03-25T22:02:50.911ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
40772025-03-25T22:02:50.911ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40782025-03-25T22:02:50.911ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40792025-03-25T22:02:50.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
40802025-03-25T22:02:50.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
40812025-03-25T22:02:50.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40822025-03-25T22:02:50.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40832025-03-25T22:02:50.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40842025-03-25T22:02:50.913ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40852025-03-25T22:02:50.914ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40862025-03-25T22:02:50.914ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
40872025-03-25T22:02:50.914ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40882025-03-25T22:02:50.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40892025-03-25T22:02:50.916ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 71.432408ms iteration = 6 status = {"errors":[],"requests_created_ok":[]}
40902025-03-25T22:02:50.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40912025-03-25T22:02:50.916ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40922025-03-25T22:02:50.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40932025-03-25T22:02:50.920ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40942025-03-25T22:02:50.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40952025-03-25T22:02:50.921ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
40962025-03-25T22:02:50.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
40972025-03-25T22:02:50.922ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
40982025-03-25T22:02:50.922ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 78.926758ms iteration = 16 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
40992025-03-25T22:02:50.922ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
41002025-03-25T22:02:50.922ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
41012025-03-25T22:02:50.922ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41022025-03-25T22:02:50.922ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 77.909611ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
41032025-03-25T22:02:50.923ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ef6a8742-0915-489d-a10b-c36c5df21348", "content-length": "26", "date": "Tue, 25 Mar 2025 22:02:50 GMT"} })
41042025-03-25T22:02:50.923ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41052025-03-25T22:02:50.925ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
41062025-03-25T22:02:50.943ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 99.163742ms iteration = 6 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
41072025-03-25T22:02:50.953ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 zone_address = fd00:1122:3344:101::2
41082025-03-25T22:02:50.953ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41092025-03-25T22:02:50.953ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2926a7b0-3506-42ed-bba3-45a97fe561d0", "content-length": "26", "date": "Tue, 25 Mar 2025 22:02:50 GMT"} })
41102025-03-25T22:02:50.953ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1184 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41112025-03-25T22:02:50.955ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
41122025-03-25T22:02:50.957ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 113.3298ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
41132025-03-25T22:02:50.962ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
41142025-03-25T22:02:50.962ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41152025-03-25T22:02:50.962ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "13e1dc93-38a7-43fd-8e57-538a03e62dcb", "content-length": "26", "date": "Tue, 25 Mar 2025 22:02:50 GMT"} })
41162025-03-25T22:02:50.962ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41172025-03-25T22:02:50.963ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
41182025-03-25T22:02:50.994ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41192025-03-25T22:02:50.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41202025-03-25T22:02:51.013ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
41212025-03-25T22:02:51.013ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
41222025-03-25T22:02:51.013ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f8228d26-0704-4303-ae2f-bc63a4a7135e", "content-length": "372", "date": "Tue, 25 Mar 2025 22:02:51 GMT"} })
41232025-03-25T22:02:51.013ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41242025-03-25T22:02:51.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41252025-03-25T22:02:51.016ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41262025-03-25T22:02:51.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41272025-03-25T22:02:51.019ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
41282025-03-25T22:02:51.019ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "f1d22123-341e-4cc3-b752-e9e71a7ced03", "content-length": "1", "date": "Tue, 25 Mar 2025 22:02:50 GMT"} })
41292025-03-25T22:02:51.020ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
41302025-03-25T22:02:51.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
41312025-03-25T22:02:51.024ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 181.217526ms iteration = 6 status = null
41322025-03-25T22:02:51.050ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 206.866793ms iteration = 6 status = {}
41332025-03-25T22:02:51.054ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41342025-03-25T22:02:51.056ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41352025-03-25T22:02:51.056ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
41362025-03-25T22:02:51.056ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
41372025-03-25T22:02:51.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
41382025-03-25T22:02:51.058ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
41392025-03-25T22:02:51.058ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41402025-03-25T22:02:51.058ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41412025-03-25T22:02:51.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41422025-03-25T22:02:51.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f034aaf6-2037-4cb4-8409-3ab31c15cc28, lookup_type: ById(f034aaf6-2037-4cb4-8409-3ab31c15cc28) } result = Ok(())
41432025-03-25T22:02:51.063ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41442025-03-25T22:02:51.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41452025-03-25T22:02:51.064ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 221.208854ms iteration = 6 status = 0
41462025-03-25T22:02:51.066ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
41472025-03-25T22:02:51.066ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
41482025-03-25T22:02:51.066ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 222.271422ms iteration = 6 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
41492025-03-25T22:02:51.071ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
41502025-03-25T22:02:51.071ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
41512025-03-25T22:02:51.072ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "816183b2-18ca-4ab8-84d7-f40e3dafdcd3", "date": "Tue, 25 Mar 2025 22:02:51 GMT"} })
41522025-03-25T22:02:51.072ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41532025-03-25T22:02:51.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41542025-03-25T22:02:51.074ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41552025-03-25T22:02:51.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41562025-03-25T22:02:51.078ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41572025-03-25T22:02:51.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41582025-03-25T22:02:51.081ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
41592025-03-25T22:02:51.082ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
41602025-03-25T22:02:51.082ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ace1c83e-4e03-4148-b136-3b0846fddbdb", "date": "Tue, 25 Mar 2025 22:02:51 GMT"} })
41612025-03-25T22:02:51.084ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 239.967732ms iteration = 6 status = {}
41622025-03-25T22:02:51.102ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:360
41632025-03-25T22:02:51.102ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 259.29423ms iteration = 6 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
41642025-03-25T22:02:51.106ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41652025-03-25T22:02:51.108ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
41662025-03-25T22:02:51.108ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41672025-03-25T22:02:51.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41682025-03-25T22:02:51.123ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41692025-03-25T22:02:51.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41702025-03-25T22:02:51.129ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a5db250-fa3f-4168-ab16-5c36568c22e2, rack_id: c7210e4b-5a81-4ec8-b8fe-816a9508dc74, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(6d5dda50-e3c4-4853-9bfa-a66b447ab351) } rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
41712025-03-25T22:02:51.129ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41722025-03-25T22:02:51.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41732025-03-25T22:02:51.136ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 293.218312ms iteration = 8 status = {"physical_disks_added":0}
41742025-03-25T22:02:51.141ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
41752025-03-25T22:02:51.141ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "9bb14a75-2b12-4304-9de2-b6568c210167", "content-length": "134", "date": "Tue, 25 Mar 2025 22:02:50 GMT"} })
41762025-03-25T22:02:51.141ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
41772025-03-25T22:02:51.141ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 6d5dda50-e3c4-4853-9bfa-a66b447ab351
41782025-03-25T22:02:51.142ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
41792025-03-25T22:02:51.142ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
41802025-03-25T22:02:51.142ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41812025-03-25T22:02:51.142ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41822025-03-25T22:02:51.142ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41832025-03-25T22:02:51.142ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
41842025-03-25T22:02:51.142ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41852025-03-25T22:02:51.142ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
41862025-03-25T22:02:51.142ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
41872025-03-25T22:02:51.142ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41882025-03-25T22:02:51.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41892025-03-25T22:02:51.144ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
41902025-03-25T22:02:51.144ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "909f2643-5f67-4c8d-bae7-5e156d5e9850", "content-length": "2", "date": "Tue, 25 Mar 2025 22:02:50 GMT"} })
41912025-03-25T22:02:51.144ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
41922025-03-25T22:02:51.144ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5f211ab-ea4d-4dec-adb8-c2cc1b9003ee", "content-length": "52", "date": "Tue, 25 Mar 2025 22:02:50 GMT"} })
41932025-03-25T22:02:51.144ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
41942025-03-25T22:02:51.144ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
41952025-03-25T22:02:51.224ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
41962025-03-25T22:02:51.247ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d4aa60d8-8432-4eac-9bf6-60389ef5a3be", "date": "Tue, 25 Mar 2025 22:02:51 GMT"} })
41972025-03-25T22:02:51.247ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch = Switch0
41982025-03-25T22:02:51.247ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
41992025-03-25T22:02:51.248ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "01f1f12b-81f8-4673-a319-8cc8e24f504d", "content-length": "691", "date": "Tue, 25 Mar 2025 22:02:51 GMT"} })
42002025-03-25T22:02:51.248ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
42012025-03-25T22:02:51.248ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
42022025-03-25T22:02:51.248ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
42032025-03-25T22:02:51.248ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c5a37c0-365b-4f6f-82da-a1fa355219c7", "content-length": "682", "date": "Tue, 25 Mar 2025 22:02:51 GMT"} })
42042025-03-25T22:02:51.248ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42052025-03-25T22:02:51.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42062025-03-25T22:02:51.249ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 406.234986ms iteration = 6 status = {}
42072025-03-25T22:02:51.252ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42082025-03-25T22:02:51.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42092025-03-25T22:02:51.256ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42102025-03-25T22:02:51.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42112025-03-25T22:02:51.259ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42122025-03-25T22:02:51.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42132025-03-25T22:02:51.266ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 423.517649ms iteration = 6 status = {}
42142025-03-25T22:02:51.449ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c786de6a-f82e-40f6-af48-a13147c4d589 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42152025-03-25T22:02:51.450ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c786de6a-f82e-40f6-af48-a13147c4d589 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42162025-03-25T22:02:51.451ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2021 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c786de6a-f82e-40f6-af48-a13147c4d589 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42172025-03-25T22:02:52.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = fe10bc1a-4ced-4a8b-8fbc-e01984eb7de5 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42182025-03-25T22:02:52.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = fe10bc1a-4ced-4a8b-8fbc-e01984eb7de5 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42192025-03-25T22:02:52.473ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1954 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = fe10bc1a-4ced-4a8b-8fbc-e01984eb7de5 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42202025-03-25T22:02:53.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2235788c-3473-4790-8723-09c78698d0a6 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42212025-03-25T22:02:53.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2235788c-3473-4790-8723-09c78698d0a6 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42222025-03-25T22:02:53.494ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2591 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2235788c-3473-4790-8723-09c78698d0a6 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42232025-03-25T22:02:54.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c9b8a2c4-9238-4092-a870-7ce95ee266e5 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42242025-03-25T22:02:54.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c9b8a2c4-9238-4092-a870-7ce95ee266e5 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42252025-03-25T22:02:54.517ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2729 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c9b8a2c4-9238-4092-a870-7ce95ee266e5 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42262025-03-25T22:02:55.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0b2a7cfc-1881-49c9-bc10-3015a152173c roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42272025-03-25T22:02:55.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0b2a7cfc-1881-49c9-bc10-3015a152173c resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42282025-03-25T22:02:55.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3334 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0b2a7cfc-1881-49c9-bc10-3015a152173c response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42292025-03-25T22:02:56.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 584feed9-8368-4123-a18e-6ad4c9ab422e roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42302025-03-25T22:02:56.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 584feed9-8368-4123-a18e-6ad4c9ab422e resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42312025-03-25T22:02:56.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1877 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 584feed9-8368-4123-a18e-6ad4c9ab422e response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42322025-03-25T22:02:57.582ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3a5f9c44-99ec-46f9-a13c-938673ff9ccc roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42332025-03-25T22:02:57.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3a5f9c44-99ec-46f9-a13c-938673ff9ccc resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42342025-03-25T22:02:57.584ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2037 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3a5f9c44-99ec-46f9-a13c-938673ff9ccc response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42352025-03-25T22:02:58.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60301 req_id = 95330ba0-136f-47f5-bed5-4c044b26d3c6 roles = RoleSet { roles: {} } uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
42362025-03-25T22:02:58.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60301 req_id = 95330ba0-136f-47f5-bed5-4c044b26d3c6 resource = Database result = Ok(()) uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
42372025-03-25T22:02:58.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3158 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60301 req_id = 95330ba0-136f-47f5-bed5-4c044b26d3c6 response_code = 200 uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
42382025-03-25T22:02:58.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60301 req_id = 09b07f44-e15b-40fb-8e1d-1fcde0321e39 roles = RoleSet { roles: {} } uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
42392025-03-25T22:02:58.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60301 req_id = 09b07f44-e15b-40fb-8e1d-1fcde0321e39 resource = Database result = Ok(()) uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
42402025-03-25T22:02:58.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2020 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60301 req_id = 09b07f44-e15b-40fb-8e1d-1fcde0321e39 response_code = 200 uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
42412025-03-25T22:02:58.572ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 481 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = 4cd7805d-5c16-4ce8-a189-e6ab72bd9606 response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
42422025-03-25T22:02:58.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c927f1ce-32c6-4c15-b014-2f83f61178fb roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42432025-03-25T22:02:58.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c927f1ce-32c6-4c15-b014-2f83f61178fb resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42442025-03-25T22:02:58.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2391 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c927f1ce-32c6-4c15-b014-2f83f61178fb response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42452025-03-25T22:02:59.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1d6d8baf-9cac-4f80-a44d-0f34e4158599 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42462025-03-25T22:02:59.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1d6d8baf-9cac-4f80-a44d-0f34e4158599 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42472025-03-25T22:02:59.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2659 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1d6d8baf-9cac-4f80-a44d-0f34e4158599 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42482025-03-25T22:03:00.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b877b039-ef42-40ea-acac-e01d3dde7011 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42492025-03-25T22:03:00.647ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b877b039-ef42-40ea-acac-e01d3dde7011 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42502025-03-25T22:03:00.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2096 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b877b039-ef42-40ea-acac-e01d3dde7011 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42512025-03-25T22:03:00.842ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
42522025-03-25T22:03:00.842ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42532025-03-25T22:03:00.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42542025-03-25T22:03:00.843ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
42552025-03-25T22:03:00.843ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42562025-03-25T22:03:00.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42572025-03-25T22:03:00.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42582025-03-25T22:03:00.845ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42592025-03-25T22:03:00.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42602025-03-25T22:03:00.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42612025-03-25T22:03:00.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42622025-03-25T22:03:00.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42632025-03-25T22:03:00.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42642025-03-25T22:03:00.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42652025-03-25T22:03:00.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42662025-03-25T22:03:00.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
42672025-03-25T22:03:00.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42682025-03-25T22:03:00.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42692025-03-25T22:03:00.863ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
42702025-03-25T22:03:00.863ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.647331ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
42712025-03-25T22:03:00.882ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 39.069763ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42722025-03-25T22:03:01.669ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = dfc3ef19-6b8c-4aa7-b32c-dce9e131a143 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42732025-03-25T22:03:01.669ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = dfc3ef19-6b8c-4aa7-b32c-dce9e131a143 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42742025-03-25T22:03:01.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1884 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = dfc3ef19-6b8c-4aa7-b32c-dce9e131a143 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42752025-03-25T22:03:02.689ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 16a53a8b-dcf4-4ee9-bfed-716542f20d35 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42762025-03-25T22:03:02.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 16a53a8b-dcf4-4ee9-bfed-716542f20d35 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42772025-03-25T22:03:02.691ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2109 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 16a53a8b-dcf4-4ee9-bfed-716542f20d35 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42782025-03-25T22:03:03.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d135800d-b0f0-491e-b4be-e3099af82828 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42792025-03-25T22:03:03.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d135800d-b0f0-491e-b4be-e3099af82828 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42802025-03-25T22:03:03.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2000 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d135800d-b0f0-491e-b4be-e3099af82828 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42812025-03-25T22:03:04.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5ea4fe6c-e4cc-4064-a679-6a7898a403bb roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42822025-03-25T22:03:04.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5ea4fe6c-e4cc-4064-a679-6a7898a403bb resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42832025-03-25T22:03:04.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1951 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5ea4fe6c-e4cc-4064-a679-6a7898a403bb response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42842025-03-25T22:03:05.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5b410e1b-e5f4-4ad3-aec2-8516a920daaa roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42852025-03-25T22:03:05.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5b410e1b-e5f4-4ad3-aec2-8516a920daaa resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42862025-03-25T22:03:05.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2135 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5b410e1b-e5f4-4ad3-aec2-8516a920daaa response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42872025-03-25T22:03:06.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4a727769-c5f5-4697-9059-56c8ed0a0046 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42882025-03-25T22:03:06.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4a727769-c5f5-4697-9059-56c8ed0a0046 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42892025-03-25T22:03:06.778ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2608 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4a727769-c5f5-4697-9059-56c8ed0a0046 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42902025-03-25T22:03:07.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 99746eb7-00e9-47fb-a84a-0d7c2e283954 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42912025-03-25T22:03:07.800ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 99746eb7-00e9-47fb-a84a-0d7c2e283954 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42922025-03-25T22:03:07.802ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2909 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 99746eb7-00e9-47fb-a84a-0d7c2e283954 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42932025-03-25T22:03:08.572ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 473 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = 056514e3-7bbc-440c-a13b-61719d9f46f2 response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
42942025-03-25T22:03:08.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 517a535e-206b-483a-83be-421bddcfc4d3 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42952025-03-25T22:03:08.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 517a535e-206b-483a-83be-421bddcfc4d3 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42962025-03-25T22:03:08.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2180 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 517a535e-206b-483a-83be-421bddcfc4d3 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42972025-03-25T22:03:09.844ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2e6d8ffd-505d-4116-9c6a-d1687eae44e3 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42982025-03-25T22:03:09.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2e6d8ffd-505d-4116-9c6a-d1687eae44e3 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
42992025-03-25T22:03:09.846ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2212 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2e6d8ffd-505d-4116-9c6a-d1687eae44e3 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
43002025-03-25T22:03:10.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
43012025-03-25T22:03:10.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43022025-03-25T22:03:10.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43032025-03-25T22:03:10.843ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
43042025-03-25T22:03:10.843ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43052025-03-25T22:03:10.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43062025-03-25T22:03:10.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43072025-03-25T22:03:10.845ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43082025-03-25T22:03:10.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43092025-03-25T22:03:10.847ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.799327ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
43102025-03-25T22:03:10.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43112025-03-25T22:03:10.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43122025-03-25T22:03:10.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43132025-03-25T22:03:10.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43142025-03-25T22:03:10.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43152025-03-25T22:03:10.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43162025-03-25T22:03:10.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
43172025-03-25T22:03:10.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43182025-03-25T22:03:10.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43192025-03-25T22:03:10.861ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
43202025-03-25T22:03:10.861ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.849292ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
43212025-03-25T22:03:10.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 48779899-5e98-4a2c-8905-824cb524f9e8 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
43222025-03-25T22:03:10.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 48779899-5e98-4a2c-8905-824cb524f9e8 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
43232025-03-25T22:03:10.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1726 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 48779899-5e98-4a2c-8905-824cb524f9e8 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
43242025-03-25T22:03:11.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 47470e7d-b97b-4a30-8ec6-6940337bfa70 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
43252025-03-25T22:03:11.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 47470e7d-b97b-4a30-8ec6-6940337bfa70 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
43262025-03-25T22:03:11.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4441 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 47470e7d-b97b-4a30-8ec6-6940337bfa70 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
43272025-03-25T22:03:12.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = cffcd869-a978-473a-9279-9cd991575cb1 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
43282025-03-25T22:03:12.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = cffcd869-a978-473a-9279-9cd991575cb1 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
43292025-03-25T22:03:12.911ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2147 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = cffcd869-a978-473a-9279-9cd991575cb1 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
43302025-03-25T22:03:13.931ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5de4cdb8-45fa-4720-a629-c65555fcefd8 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
43312025-03-25T22:03:13.931ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5de4cdb8-45fa-4720-a629-c65555fcefd8 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
43322025-03-25T22:03:13.933ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2074 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5de4cdb8-45fa-4720-a629-c65555fcefd8 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
43332025-03-25T22:03:14.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 427ccec7-a4a9-410d-9cd3-08fc4551cb8d roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
43342025-03-25T22:03:14.954ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 427ccec7-a4a9-410d-9cd3-08fc4551cb8d resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
43352025-03-25T22:03:14.956ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2778 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 427ccec7-a4a9-410d-9cd3-08fc4551cb8d response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
43362025-03-25T22:03:15.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 87e4fbf2-b040-4b89-9d42-caf61448090d roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
43372025-03-25T22:03:15.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 87e4fbf2-b040-4b89-9d42-caf61448090d resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
43382025-03-25T22:03:15.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2617 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 87e4fbf2-b040-4b89-9d42-caf61448090d response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
43392025-03-25T22:03:16.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3cda034f-6a08-4c2a-b382-642be837e186 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
43402025-03-25T22:03:16.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3cda034f-6a08-4c2a-b382-642be837e186 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
43412025-03-25T22:03:16.999ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2425 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3cda034f-6a08-4c2a-b382-642be837e186 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
43422025-03-25T22:03:18.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1a67a40f-9fc3-4ec7-a572-9a08be09009c roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
43432025-03-25T22:03:18.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1a67a40f-9fc3-4ec7-a572-9a08be09009c resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
43442025-03-25T22:03:18.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2304 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1a67a40f-9fc3-4ec7-a572-9a08be09009c response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
43452025-03-25T22:03:18.572ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 542 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = d3df7a97-8f66-4297-af94-7bba74941569 response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
43462025-03-25T22:03:19.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 57d4642e-46cd-40d0-a748-d42d84257207 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
43472025-03-25T22:03:19.041ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 57d4642e-46cd-40d0-a748-d42d84257207 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
43482025-03-25T22:03:19.043ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1998 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 57d4642e-46cd-40d0-a748-d42d84257207 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
43492025-03-25T22:03:20.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1ad9cc51-6b6a-473a-811d-1db053f77295 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
43502025-03-25T22:03:20.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1ad9cc51-6b6a-473a-811d-1db053f77295 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
43512025-03-25T22:03:20.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2261 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1ad9cc51-6b6a-473a-811d-1db053f77295 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
43522025-03-25T22:03:20.843ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
43532025-03-25T22:03:20.843ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
43542025-03-25T22:03:20.843ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 7 reason = Timeout
43552025-03-25T22:03:20.843ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
43562025-03-25T22:03:20.843ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43572025-03-25T22:03:20.843ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
43582025-03-25T22:03:20.843ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43592025-03-25T22:03:20.843ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 7 reason = Timeout
43602025-03-25T22:03:20.843ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
43612025-03-25T22:03:20.843ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
43622025-03-25T22:03:20.843ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
43632025-03-25T22:03:20.843ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43642025-03-25T22:03:20.843ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
43652025-03-25T22:03:20.843ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 4 reason = Timeout
43662025-03-25T22:03:20.843ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
43672025-03-25T22:03:20.843ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43682025-03-25T22:03:20.843ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
43692025-03-25T22:03:20.843ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-03-25 21:53:20.843888480 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
43702025-03-25T22:03:20.843ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
43712025-03-25T22:03:20.843ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 4 reason = Timeout
43722025-03-25T22:03:20.843ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 4 reason = Timeout
43732025-03-25T22:03:20.843ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
43742025-03-25T22:03:20.843ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
43752025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
43762025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
43772025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43782025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43792025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 4 reason = Timeout
43802025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
43812025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43822025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43832025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
43842025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
43852025-03-25T22:03:20.844ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
43862025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43872025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43882025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
43892025-03-25T22:03:20.844ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
43902025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
43912025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
43922025-03-25T22:03:20.844ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:82 reason = blueprint disabled target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7
43932025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.771\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7"}
43942025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 4 reason = Timeout
43952025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
43962025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 4 reason = Timeout
43972025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43982025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
43992025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
44002025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
44012025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
44022025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
44032025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
44042025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
44052025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
44062025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
44072025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
44082025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
44092025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
44102025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 7 reason = Timeout
44112025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
44122025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
44132025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44142025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44152025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
44162025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
44172025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44182025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
44192025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
44202025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
44212025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
44222025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
44232025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44242025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
44252025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44262025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44272025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
44282025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44292025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
44302025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
44312025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44322025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44332025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44342025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
44352025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
44362025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
44372025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44382025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44392025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
44402025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
44412025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
44422025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44432025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
44442025-03-25T22:03:20.844ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("58d382a7-99da-40a7-bc9f-2da7e9b156c1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d42076c6-06fe-4102-a978-c7d0a8dffb98.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d42076c6-06fe-4102-a978-c7d0a8dffb98.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 6354, tv_nsec: 181294445 } })
44452025-03-25T22:03:20.844ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5533f428-2028-4269-b7b1-f15912c01133.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("66b022b6-2e12-413e-b4b7-56c4ad5bdd77.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f337d25b-c67a-4a32-89e1-e187aea97ed9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f337d25b-c67a-4a32-89e1-e187aea97ed9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 6354, tv_nsec: 181305335 } })
44462025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
44472025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
44482025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
44492025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
44502025-03-25T22:03:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
44512025-03-25T22:03:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
44522025-03-25T22:03:20.845ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
44532025-03-25T22:03:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
44542025-03-25T22:03:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
44552025-03-25T22:03:20.845ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
44562025-03-25T22:03:20.845ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
44572025-03-25T22:03:20.845ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.403435ms iteration = 4 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
44582025-03-25T22:03:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
44592025-03-25T22:03:20.845ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
44602025-03-25T22:03:20.845ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.317943ms iteration = 4 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
44612025-03-25T22:03:20.846ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44622025-03-25T22:03:20.847ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.991082ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
44632025-03-25T22:03:20.847ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6354, tv_nsec: 184066784 } })
44642025-03-25T22:03:20.847ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1171
44652025-03-25T22:03:20.848ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44662025-03-25T22:03:20.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
44672025-03-25T22:03:20.849ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44682025-03-25T22:03:20.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44692025-03-25T22:03:20.849ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 5.723209ms iteration = 7 status = {"errors":[],"requests_created_ok":[]}
44702025-03-25T22:03:20.850ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44712025-03-25T22:03:20.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44722025-03-25T22:03:20.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
44732025-03-25T22:03:20.850ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44742025-03-25T22:03:20.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44752025-03-25T22:03:20.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44762025-03-25T22:03:20.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44772025-03-25T22:03:20.852ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44782025-03-25T22:03:20.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44792025-03-25T22:03:20.852ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-03-25 21:53:20.843888480 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
44802025-03-25T22:03:20.852ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 8.956636ms iteration = 4 status = {"expiration":"2025-03-25T21:53:20.843888480Z","pruned":[]}
44812025-03-25T22:03:20.853ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44822025-03-25T22:03:20.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
44832025-03-25T22:03:20.855ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
44842025-03-25T22:03:20.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
44852025-03-25T22:03:20.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44862025-03-25T22:03:20.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44872025-03-25T22:03:20.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
44882025-03-25T22:03:20.855ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
44892025-03-25T22:03:20.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44902025-03-25T22:03:20.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
44912025-03-25T22:03:20.857ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44922025-03-25T22:03:20.858ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6354, tv_nsec: 194465605 } })
44932025-03-25T22:03:20.858ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1171
44942025-03-25T22:03:20.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
44952025-03-25T22:03:20.859ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44962025-03-25T22:03:20.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44972025-03-25T22:03:20.860ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44982025-03-25T22:03:20.861ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44992025-03-25T22:03:20.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45002025-03-25T22:03:20.862ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
45012025-03-25T22:03:20.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
45022025-03-25T22:03:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
45032025-03-25T22:03:20.863ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
45042025-03-25T22:03:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
45052025-03-25T22:03:20.864ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45062025-03-25T22:03:20.866ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 21.845712ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
45072025-03-25T22:03:20.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
45082025-03-25T22:03:20.867ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
45092025-03-25T22:03:20.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
45102025-03-25T22:03:20.869ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45112025-03-25T22:03:20.870ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45122025-03-25T22:03:20.870ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45132025-03-25T22:03:20.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45142025-03-25T22:03:20.870ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
45152025-03-25T22:03:20.871ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
45162025-03-25T22:03:20.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
45172025-03-25T22:03:20.871ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45182025-03-25T22:03:20.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
45192025-03-25T22:03:20.873ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
45202025-03-25T22:03:20.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
45212025-03-25T22:03:20.875ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
45222025-03-25T22:03:20.877ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.859282ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45232025-03-25T22:03:20.878ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45242025-03-25T22:03:20.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45252025-03-25T22:03:20.882ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45262025-03-25T22:03:20.885ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45272025-03-25T22:03:20.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45282025-03-25T22:03:20.885ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6354, tv_nsec: 222198830 } })
45292025-03-25T22:03:20.885ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
45302025-03-25T22:03:20.886ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1171 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
45312025-03-25T22:03:20.905ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45322025-03-25T22:03:20.907ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
45332025-03-25T22:03:20.907ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45342025-03-25T22:03:20.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45352025-03-25T22:03:20.911ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
45362025-03-25T22:03:20.911ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
45372025-03-25T22:03:20.911ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
45382025-03-25T22:03:20.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
45392025-03-25T22:03:20.912ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45402025-03-25T22:03:20.914ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
45412025-03-25T22:03:20.915ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
45422025-03-25T22:03:20.915ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45432025-03-25T22:03:20.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
45442025-03-25T22:03:20.918ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45452025-03-25T22:03:20.919ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
45462025-03-25T22:03:20.919ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45472025-03-25T22:03:20.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45482025-03-25T22:03:20.921ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
45492025-03-25T22:03:20.921ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
45502025-03-25T22:03:20.921ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
45512025-03-25T22:03:20.921ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 77.328061ms iteration = 4 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
45522025-03-25T22:03:20.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
45532025-03-25T22:03:20.922ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
45542025-03-25T22:03:20.922ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
45552025-03-25T22:03:20.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
45562025-03-25T22:03:20.923ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45572025-03-25T22:03:20.923ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
45582025-03-25T22:03:20.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
45592025-03-25T22:03:20.924ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45602025-03-25T22:03:20.925ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
45612025-03-25T22:03:20.925ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
45622025-03-25T22:03:20.925ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
45632025-03-25T22:03:20.925ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45642025-03-25T22:03:20.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45652025-03-25T22:03:20.926ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
45662025-03-25T22:03:20.926ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45672025-03-25T22:03:20.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45682025-03-25T22:03:20.927ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
45692025-03-25T22:03:20.927ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45702025-03-25T22:03:20.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45712025-03-25T22:03:20.928ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 84.507456ms iteration = 3 status = {"nsuccess":5}
45722025-03-25T22:03:20.932ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45732025-03-25T22:03:20.932ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
45742025-03-25T22:03:20.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
45752025-03-25T22:03:20.932ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 86.397169ms iteration = 7 status = {"errors":[],"finish_invoked_ok":[]}
45762025-03-25T22:03:20.932ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45772025-03-25T22:03:20.933ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45782025-03-25T22:03:20.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45792025-03-25T22:03:20.934ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
45802025-03-25T22:03:20.935ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45812025-03-25T22:03:20.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45822025-03-25T22:03:20.937ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
45832025-03-25T22:03:20.937ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
45842025-03-25T22:03:20.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
45852025-03-25T22:03:20.938ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
45862025-03-25T22:03:20.938ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 94.503451ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
45872025-03-25T22:03:20.945ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 101.673956ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
45882025-03-25T22:03:20.945ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
45892025-03-25T22:03:20.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
45902025-03-25T22:03:20.946ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45912025-03-25T22:03:20.946ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
45922025-03-25T22:03:20.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
45932025-03-25T22:03:20.947ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
45942025-03-25T22:03:20.947ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
45952025-03-25T22:03:20.947ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
45962025-03-25T22:03:20.947ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45972025-03-25T22:03:20.947ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45982025-03-25T22:03:20.948ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
45992025-03-25T22:03:20.948ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
46002025-03-25T22:03:20.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46012025-03-25T22:03:20.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
46022025-03-25T22:03:20.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
46032025-03-25T22:03:20.953ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
46042025-03-25T22:03:20.953ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
46052025-03-25T22:03:20.953ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 109.88017ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
46062025-03-25T22:03:20.954ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
46072025-03-25T22:03:20.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
46082025-03-25T22:03:20.970ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
46092025-03-25T22:03:20.970ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
46102025-03-25T22:03:20.970ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46112025-03-25T22:03:20.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46122025-03-25T22:03:20.982ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 138.142023ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
46132025-03-25T22:03:20.993ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
46142025-03-25T22:03:20.993ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
46152025-03-25T22:03:20.993ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9843a5b8-7e1a-48ea-ad8b-c0b6434ff248", "content-length": "26", "date": "Tue, 25 Mar 2025 22:03:20 GMT"} })
46162025-03-25T22:03:20.994ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46172025-03-25T22:03:20.995ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
46182025-03-25T22:03:20.999ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
46192025-03-25T22:03:21.027ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 zone_address = fd00:1122:3344:101::2
46202025-03-25T22:03:21.027ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
46212025-03-25T22:03:21.028ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "36a855b3-4412-4b8c-b3d0-71ef27ef0ba4", "content-length": "26", "date": "Tue, 25 Mar 2025 22:03:20 GMT"} })
46222025-03-25T22:03:21.028ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1184 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46232025-03-25T22:03:21.029ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
46242025-03-25T22:03:21.048ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 204.602174ms iteration = 9 status = {"physical_disks_added":0}
46252025-03-25T22:03:21.051ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
46262025-03-25T22:03:21.051ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
46272025-03-25T22:03:21.051ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "36f492d1-1bca-4da5-b03f-2afdb2fa4181", "content-length": "26", "date": "Tue, 25 Mar 2025 22:03:20 GMT"} })
46282025-03-25T22:03:21.051ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46292025-03-25T22:03:21.053ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
46302025-03-25T22:03:21.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b70c3137-828d-4459-be96-b928d6a7aae5 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
46312025-03-25T22:03:21.086ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b70c3137-828d-4459-be96-b928d6a7aae5 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
46322025-03-25T22:03:21.091ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
46332025-03-25T22:03:21.202ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
46342025-03-25T22:03:21.203ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "91211c71-50f3-487e-a373-8cd4680a0e82", "content-length": "1", "date": "Tue, 25 Mar 2025 22:03:20 GMT"} })
46352025-03-25T22:03:21.205ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
46362025-03-25T22:03:21.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
46372025-03-25T22:03:21.216ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 371.907727ms iteration = 7 status = {}
46382025-03-25T22:03:21.218ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
46392025-03-25T22:03:21.229ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
46402025-03-25T22:03:21.229ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
46412025-03-25T22:03:21.229ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "df7f3957-1e5b-469b-a25f-45cb713cd1b5", "content-length": "372", "date": "Tue, 25 Mar 2025 22:03:21 GMT"} })
46422025-03-25T22:03:21.229ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46432025-03-25T22:03:21.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46442025-03-25T22:03:21.233ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46452025-03-25T22:03:21.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46462025-03-25T22:03:21.238ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 152510 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b70c3137-828d-4459-be96-b928d6a7aae5 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
46472025-03-25T22:03:21.239ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 395.464068ms iteration = 7 status = null
46482025-03-25T22:03:21.271ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
46492025-03-25T22:03:21.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
46502025-03-25T22:03:21.281ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46512025-03-25T22:03:21.282ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
46522025-03-25T22:03:21.282ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 23d93905-7b89-4296-b050-7ff9ae235c15 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
46532025-03-25T22:03:21.282ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
46542025-03-25T22:03:21.282ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46552025-03-25T22:03:21.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
46562025-03-25T22:03:21.285ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
46572025-03-25T22:03:21.285ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
46582025-03-25T22:03:21.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
46592025-03-25T22:03:21.285ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 441.215117ms iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
46602025-03-25T22:03:21.286ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
46612025-03-25T22:03:21.287ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
46622025-03-25T22:03:21.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
46632025-03-25T22:03:21.288ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 444.146329ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
46642025-03-25T22:03:21.289ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46652025-03-25T22:03:21.289ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
46662025-03-25T22:03:21.289ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "0c174a84-a859-4083-8ff3-7b562cf5adc0", "date": "Tue, 25 Mar 2025 22:03:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
46672025-03-25T22:03:21.289ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
46682025-03-25T22:03:21.291ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "0eeaadd8-d577-42f6-b70b-4918593fc201", "date": "Tue, 25 Mar 2025 22:03:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
46692025-03-25T22:03:21.291ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
46702025-03-25T22:03:21.291ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
46712025-03-25T22:03:21.291ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
46722025-03-25T22:03:21.291ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 447.712211ms iteration = 7 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
46732025-03-25T22:03:21.293ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f034aaf6-2037-4cb4-8409-3ab31c15cc28, lookup_type: ById(f034aaf6-2037-4cb4-8409-3ab31c15cc28) } result = Ok(())
46742025-03-25T22:03:21.293ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46752025-03-25T22:03:21.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46762025-03-25T22:03:21.293ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
46772025-03-25T22:03:21.293ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 449.895059ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
46782025-03-25T22:03:21.295ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
46792025-03-25T22:03:21.295ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 450.828545ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
46802025-03-25T22:03:21.295ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 451.796582ms iteration = 7 status = 0
46812025-03-25T22:03:21.301ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
46822025-03-25T22:03:21.302ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "1e694743-9c51-416b-98c0-660ff4cbe4d1", "date": "Tue, 25 Mar 2025 22:03:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
46832025-03-25T22:03:21.302ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
46842025-03-25T22:03:21.304ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "b0e260fc-1c40-4969-9dc6-de39917f452e", "date": "Tue, 25 Mar 2025 22:03:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
46852025-03-25T22:03:21.304ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
46862025-03-25T22:03:21.306ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "7ab60284-8296-4df5-89e2-34a81fcde2d0", "date": "Tue, 25 Mar 2025 22:03:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
46872025-03-25T22:03:21.306ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
46882025-03-25T22:03:21.308ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
46892025-03-25T22:03:21.308ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 464.79058ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
46902025-03-25T22:03:21.316ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46912025-03-25T22:03:21.318ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
46922025-03-25T22:03:21.318ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
46932025-03-25T22:03:21.319ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
46942025-03-25T22:03:21.319ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "bb10b7ab-3eb4-4120-bf94-ca7132bd4daa", "date": "Tue, 25 Mar 2025 22:03:21 GMT"} })
46952025-03-25T22:03:21.319ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
46962025-03-25T22:03:21.319ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46972025-03-25T22:03:21.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
46982025-03-25T22:03:21.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46992025-03-25T22:03:21.322ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47002025-03-25T22:03:21.323ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
47012025-03-25T22:03:21.323ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 96679ce4-e18c-487b-803a-7b26be55e85c dns_zone_name = oxide.test found_so_far = 0 version = 2
47022025-03-25T22:03:21.323ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
47032025-03-25T22:03:21.323ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47042025-03-25T22:03:21.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47052025-03-25T22:03:21.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
47062025-03-25T22:03:21.326ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
47072025-03-25T22:03:21.326ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
47082025-03-25T22:03:21.326ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:360
47092025-03-25T22:03:21.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
47102025-03-25T22:03:21.326ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 482.55332ms iteration = 7 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
47112025-03-25T22:03:21.326ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47122025-03-25T22:03:21.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47132025-03-25T22:03:21.329ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 23d93905-7b89-4296-b050-7ff9ae235c15 dns_zone_name = control-plane.oxide.internal found_so_far = 52 version = 1
47142025-03-25T22:03:21.329ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
47152025-03-25T22:03:21.329ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-03-25 22:00:21.368103 UTC dns_group = internal generation = 1
47162025-03-25T22:03:21.329ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 485.645193ms iteration = 4 status = {"generation":1}
47172025-03-25T22:03:21.329ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
47182025-03-25T22:03:21.329ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
47192025-03-25T22:03:21.329ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6245034e-08fd-4726-b1b6-ae851b4cc9ec", "date": "Tue, 25 Mar 2025 22:03:21 GMT"} })
47202025-03-25T22:03:21.331ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 487.566826ms iteration = 7 status = {}
47212025-03-25T22:03:21.342ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47222025-03-25T22:03:21.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47232025-03-25T22:03:21.345ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a5db250-fa3f-4168-ab16-5c36568c22e2, rack_id: c7210e4b-5a81-4ec8-b8fe-816a9508dc74, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(6d5dda50-e3c4-4853-9bfa-a66b447ab351) } rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
47242025-03-25T22:03:21.345ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47252025-03-25T22:03:21.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47262025-03-25T22:03:21.349ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
47272025-03-25T22:03:21.349ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 505.726414ms iteration = 4 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
47282025-03-25T22:03:21.352ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-03-25T22:00:16.382271Z, time_modified: 2025-03-25T22:00:16.382271Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, db_silo: Silo { identity: SiloIdentity { id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-25T22:00:22.501108Z, time_modified: 2025-03-25T22:00:22.501108Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, db_silo: Silo { identity: SiloIdentity { id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-25T22:00:22.501108Z, time_modified: 2025-03-25T22:00:22.501108Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d" }] }) }
47292025-03-25T22:03:21.352ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 508.34937ms iteration = 4 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"5c35ff8c-21dd-48b9-9751-76bfa681bc38","tls_certs":["0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d"]}},"default_endpoint":{"silo_id":"5c35ff8c-21dd-48b9-9751-76bfa681bc38","tls_certs":["0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
47302025-03-25T22:03:21.355ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47312025-03-25T22:03:21.357ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
47322025-03-25T22:03:21.357ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "cca2d073-8cbb-4f0e-b48f-b8fb69f1fe9b", "content-length": "134", "date": "Tue, 25 Mar 2025 22:03:21 GMT"} })
47332025-03-25T22:03:21.357ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
47342025-03-25T22:03:21.357ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 6d5dda50-e3c4-4853-9bfa-a66b447ab351
47352025-03-25T22:03:21.357ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
47362025-03-25T22:03:21.357ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
47372025-03-25T22:03:21.357ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47382025-03-25T22:03:21.357ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47392025-03-25T22:03:21.357ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47402025-03-25T22:03:21.357ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
47412025-03-25T22:03:21.358ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47422025-03-25T22:03:21.358ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
47432025-03-25T22:03:21.358ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
47442025-03-25T22:03:21.358ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47452025-03-25T22:03:21.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47462025-03-25T22:03:21.358ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
47472025-03-25T22:03:21.358ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
47482025-03-25T22:03:21.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
47492025-03-25T22:03:21.361ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 96679ce4-e18c-487b-803a-7b26be55e85c dns_zone_name = oxide.test found_so_far = 1 version = 2
47502025-03-25T22:03:21.361ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
47512025-03-25T22:03:21.361ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-03-25 22:00:22.561696 UTC dns_group = external generation = 2
47522025-03-25T22:03:21.361ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 517.035962ms iteration = 4 status = {"generation":2}
47532025-03-25T22:03:21.361ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47542025-03-25T22:03:21.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47552025-03-25T22:03:21.363ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47562025-03-25T22:03:21.365ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
47572025-03-25T22:03:21.365ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47582025-03-25T22:03:21.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47592025-03-25T22:03:21.366ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47602025-03-25T22:03:21.367ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
47612025-03-25T22:03:21.367ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "3fe8f5f4-e7ca-41fa-909d-406b88c81e1e", "content-length": "2", "date": "Tue, 25 Mar 2025 22:03:21 GMT"} })
47622025-03-25T22:03:21.367ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
47632025-03-25T22:03:21.367ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "2765503b-a853-4d0e-b4d1-1e1810f8a617", "content-length": "52", "date": "Tue, 25 Mar 2025 22:03:21 GMT"} })
47642025-03-25T22:03:21.367ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
47652025-03-25T22:03:21.367ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
47662025-03-25T22:03:21.368ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
47672025-03-25T22:03:21.368ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47682025-03-25T22:03:21.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47692025-03-25T22:03:21.464ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
47702025-03-25T22:03:21.468ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "11dc259b-bab7-40de-adea-4c068164b96d", "content-length": "691", "date": "Tue, 25 Mar 2025 22:03:21 GMT"} })
47712025-03-25T22:03:21.468ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
47722025-03-25T22:03:21.468ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
47732025-03-25T22:03:21.468ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
47742025-03-25T22:03:21.470ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 626.698268ms iteration = 7 status = {}
47752025-03-25T22:03:21.477ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "22feb3a8-113d-47ff-b033-c9673137f0cd", "date": "Tue, 25 Mar 2025 22:03:21 GMT"} })
47762025-03-25T22:03:21.477ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch = Switch0
47772025-03-25T22:03:21.477ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
47782025-03-25T22:03:21.481ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f10a1024-63cd-470a-ad77-4cd82c64945d", "content-length": "682", "date": "Tue, 25 Mar 2025 22:03:21 GMT"} })
47792025-03-25T22:03:21.481ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47802025-03-25T22:03:21.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47812025-03-25T22:03:21.484ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47822025-03-25T22:03:21.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47832025-03-25T22:03:21.488ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47842025-03-25T22:03:21.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47852025-03-25T22:03:21.490ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47862025-03-25T22:03:21.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47872025-03-25T22:03:21.497ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 653.291712ms iteration = 7 status = {}
47882025-03-25T22:03:22.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8cf221e9-8e1f-4c6d-8a14-449f50c22e42 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
47892025-03-25T22:03:22.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8cf221e9-8e1f-4c6d-8a14-449f50c22e42 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
47902025-03-25T22:03:22.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2584 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8cf221e9-8e1f-4c6d-8a14-449f50c22e42 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
47912025-03-25T22:03:23.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7ed43d7d-0f29-42f3-b047-0a212da7f0dc roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
47922025-03-25T22:03:23.290ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7ed43d7d-0f29-42f3-b047-0a212da7f0dc resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
47932025-03-25T22:03:23.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2431 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7ed43d7d-0f29-42f3-b047-0a212da7f0dc response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
47942025-03-25T22:03:24.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0056a8c5-d1f1-4918-bc1e-b97b5473fdbf roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
47952025-03-25T22:03:24.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0056a8c5-d1f1-4918-bc1e-b97b5473fdbf resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
47962025-03-25T22:03:24.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2433 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0056a8c5-d1f1-4918-bc1e-b97b5473fdbf response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
47972025-03-25T22:03:25.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 62882c5f-b19f-4d56-82c4-b38ac9f971c8 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
47982025-03-25T22:03:25.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 62882c5f-b19f-4d56-82c4-b38ac9f971c8 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
47992025-03-25T22:03:25.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2032 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 62882c5f-b19f-4d56-82c4-b38ac9f971c8 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48002025-03-25T22:03:26.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3c219d17-905e-4597-9f74-1e973794ce77 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48012025-03-25T22:03:26.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3c219d17-905e-4597-9f74-1e973794ce77 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48022025-03-25T22:03:26.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2606 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3c219d17-905e-4597-9f74-1e973794ce77 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48032025-03-25T22:03:27.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3dab3177-8415-4f91-8a4d-ee3dd9d32b22 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48042025-03-25T22:03:27.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3dab3177-8415-4f91-8a4d-ee3dd9d32b22 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48052025-03-25T22:03:27.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2063 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3dab3177-8415-4f91-8a4d-ee3dd9d32b22 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48062025-03-25T22:03:28.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 32401f7b-d05f-48cf-842c-ca26edcf15dc roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48072025-03-25T22:03:28.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 32401f7b-d05f-48cf-842c-ca26edcf15dc resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48082025-03-25T22:03:28.399ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2098 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 32401f7b-d05f-48cf-842c-ca26edcf15dc response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48092025-03-25T22:03:28.572ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 576 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = e700a5d0-8ffd-4485-973d-75ede104d370 response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
48102025-03-25T22:03:29.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0d34a538-3361-4266-8d56-362c5fa04de3 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48112025-03-25T22:03:29.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0d34a538-3361-4266-8d56-362c5fa04de3 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48122025-03-25T22:03:29.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2406 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0d34a538-3361-4266-8d56-362c5fa04de3 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48132025-03-25T22:03:30.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ad4e134b-d0c9-42c8-993e-e87981568d75 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48142025-03-25T22:03:30.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ad4e134b-d0c9-42c8-993e-e87981568d75 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48152025-03-25T22:03:30.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1831 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ad4e134b-d0c9-42c8-993e-e87981568d75 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48162025-03-25T22:03:30.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
48172025-03-25T22:03:30.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48182025-03-25T22:03:30.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48192025-03-25T22:03:30.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
48202025-03-25T22:03:30.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48212025-03-25T22:03:30.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48222025-03-25T22:03:30.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48232025-03-25T22:03:30.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48242025-03-25T22:03:30.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48252025-03-25T22:03:30.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48262025-03-25T22:03:30.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48272025-03-25T22:03:30.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48282025-03-25T22:03:30.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48292025-03-25T22:03:30.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
48302025-03-25T22:03:30.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48312025-03-25T22:03:30.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48322025-03-25T22:03:30.867ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
48332025-03-25T22:03:30.867ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.701931ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
48342025-03-25T22:03:30.877ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48352025-03-25T22:03:30.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48362025-03-25T22:03:30.911ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 66.97382ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48372025-03-25T22:03:31.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6b6b6cd1-b2f5-49b0-a70a-0b707eed4f74 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48382025-03-25T22:03:31.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6b6b6cd1-b2f5-49b0-a70a-0b707eed4f74 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48392025-03-25T22:03:31.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1905 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6b6b6cd1-b2f5-49b0-a70a-0b707eed4f74 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48402025-03-25T22:03:32.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8e354a8e-3948-482d-88c2-68896b9eeaff roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48412025-03-25T22:03:32.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8e354a8e-3948-482d-88c2-68896b9eeaff resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48422025-03-25T22:03:32.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2469 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8e354a8e-3948-482d-88c2-68896b9eeaff response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48432025-03-25T22:03:33.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d71d141e-179c-4611-a524-094f5c4761f1 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48442025-03-25T22:03:33.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d71d141e-179c-4611-a524-094f5c4761f1 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48452025-03-25T22:03:33.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1969 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d71d141e-179c-4611-a524-094f5c4761f1 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48462025-03-25T22:03:34.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d8c5fa8a-d573-4141-a8d2-ed41d0e13833 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48472025-03-25T22:03:34.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d8c5fa8a-d573-4141-a8d2-ed41d0e13833 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48482025-03-25T22:03:34.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2078 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d8c5fa8a-d573-4141-a8d2-ed41d0e13833 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48492025-03-25T22:03:35.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 62fbe094-716d-45ba-a933-676d4cd4aee5 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48502025-03-25T22:03:35.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 62fbe094-716d-45ba-a933-676d4cd4aee5 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48512025-03-25T22:03:35.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2204 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 62fbe094-716d-45ba-a933-676d4cd4aee5 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48522025-03-25T22:03:36.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 945d1122-1a8d-46d0-a218-8ca0faf46c48 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48532025-03-25T22:03:36.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 945d1122-1a8d-46d0-a218-8ca0faf46c48 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48542025-03-25T22:03:36.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2093 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 945d1122-1a8d-46d0-a218-8ca0faf46c48 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48552025-03-25T22:03:37.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 348b1084-1189-480f-a510-d372dc636ab4 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48562025-03-25T22:03:37.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 348b1084-1189-480f-a510-d372dc636ab4 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48572025-03-25T22:03:37.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2235 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 348b1084-1189-480f-a510-d372dc636ab4 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48582025-03-25T22:03:38.572ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 647 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = 13ad4a0b-92bb-4a08-856d-e800952f943e response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
48592025-03-25T22:03:38.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8d8dd156-fd1d-4b40-80da-10314f268a42 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48602025-03-25T22:03:38.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8d8dd156-fd1d-4b40-80da-10314f268a42 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48612025-03-25T22:03:38.615ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2746 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8d8dd156-fd1d-4b40-80da-10314f268a42 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48622025-03-25T22:03:39.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ed4ce35a-6ae9-4f9a-985b-9aafa294400f roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48632025-03-25T22:03:39.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ed4ce35a-6ae9-4f9a-985b-9aafa294400f resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48642025-03-25T22:03:39.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1952 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ed4ce35a-6ae9-4f9a-985b-9aafa294400f response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48652025-03-25T22:03:40.657ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a2e9500b-9d0e-407e-a07f-128090579fd5 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48662025-03-25T22:03:40.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a2e9500b-9d0e-407e-a07f-128090579fd5 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48672025-03-25T22:03:40.660ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2446 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a2e9500b-9d0e-407e-a07f-128090579fd5 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48682025-03-25T22:03:40.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
48692025-03-25T22:03:40.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48702025-03-25T22:03:40.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48712025-03-25T22:03:40.843ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
48722025-03-25T22:03:40.843ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48732025-03-25T22:03:40.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48742025-03-25T22:03:40.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48752025-03-25T22:03:40.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48762025-03-25T22:03:40.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48772025-03-25T22:03:40.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48782025-03-25T22:03:40.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48792025-03-25T22:03:40.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48802025-03-25T22:03:40.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48812025-03-25T22:03:40.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
48822025-03-25T22:03:40.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48832025-03-25T22:03:40.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48842025-03-25T22:03:40.864ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
48852025-03-25T22:03:40.864ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.815111ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
48862025-03-25T22:03:40.876ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48872025-03-25T22:03:40.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48882025-03-25T22:03:40.878ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 34.439822ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48892025-03-25T22:03:41.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 07074e2f-9471-4496-85a8-9aca7c1e065e roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48902025-03-25T22:03:41.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 07074e2f-9471-4496-85a8-9aca7c1e065e resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48912025-03-25T22:03:41.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2084 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 07074e2f-9471-4496-85a8-9aca7c1e065e response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48922025-03-25T22:03:42.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1bee53db-c697-4f31-bde0-b4c09f533dfc roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48932025-03-25T22:03:42.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1bee53db-c697-4f31-bde0-b4c09f533dfc resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48942025-03-25T22:03:42.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2257 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1bee53db-c697-4f31-bde0-b4c09f533dfc response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
48952025-03-25T22:03:43.565ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:61604
48962025-03-25T22:03:43.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61604 req_id = ecd78b7e-72d5-4a1b-80ea-376d6bef4875 roles = RoleSet { roles: {} } uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
48972025-03-25T22:03:43.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61604 req_id = ecd78b7e-72d5-4a1b-80ea-376d6bef4875 resource = Database result = Ok(()) uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
48982025-03-25T22:03:43.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2932 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61604 req_id = ecd78b7e-72d5-4a1b-80ea-376d6bef4875 response_code = 200 uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
48992025-03-25T22:03:43.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61604 req_id = bc43ac6c-49ea-4bd7-b7ff-17796b1c756c roles = RoleSet { roles: {} } uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
49002025-03-25T22:03:43.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61604 req_id = bc43ac6c-49ea-4bd7-b7ff-17796b1c756c resource = Database result = Ok(()) uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
49012025-03-25T22:03:43.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2498 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61604 req_id = bc43ac6c-49ea-4bd7-b7ff-17796b1c756c response_code = 200 uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
49022025-03-25T22:03:43.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f5b0c4f1-25c1-40cd-a5f5-3a62b1e1ce0f roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
49032025-03-25T22:03:43.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f5b0c4f1-25c1-40cd-a5f5-3a62b1e1ce0f resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
49042025-03-25T22:03:43.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2639 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f5b0c4f1-25c1-40cd-a5f5-3a62b1e1ce0f response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
49052025-03-25T22:03:44.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ac679bb9-e1d7-4a2c-b71a-8370fa2f2e5c roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
49062025-03-25T22:03:44.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ac679bb9-e1d7-4a2c-b71a-8370fa2f2e5c resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
49072025-03-25T22:03:44.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2306 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ac679bb9-e1d7-4a2c-b71a-8370fa2f2e5c response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
49082025-03-25T22:03:45.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b969fef8-9260-4528-9e92-c8fa91c34fd8 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
49092025-03-25T22:03:45.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b969fef8-9260-4528-9e92-c8fa91c34fd8 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
49102025-03-25T22:03:45.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1977 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b969fef8-9260-4528-9e92-c8fa91c34fd8 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
49112025-03-25T22:03:46.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 211f6461-a1ce-4614-ba64-8c0bf8e63c49 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
49122025-03-25T22:03:46.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 211f6461-a1ce-4614-ba64-8c0bf8e63c49 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
49132025-03-25T22:03:46.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1756 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 211f6461-a1ce-4614-ba64-8c0bf8e63c49 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
49142025-03-25T22:03:47.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b4ded822-db9a-4605-8d80-32f5f29fc536 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
49152025-03-25T22:03:47.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b4ded822-db9a-4605-8d80-32f5f29fc536 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
49162025-03-25T22:03:47.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2042 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b4ded822-db9a-4605-8d80-32f5f29fc536 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
49172025-03-25T22:03:48.572ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 883 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = 7806bae3-f4cf-4a6e-bd1f-4d0f38f6ef7e response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
49182025-03-25T22:03:48.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = fbadc5d4-72a0-400c-9d5b-5f4edab634b6 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
49192025-03-25T22:03:48.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = fbadc5d4-72a0-400c-9d5b-5f4edab634b6 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
49202025-03-25T22:03:48.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2315 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = fbadc5d4-72a0-400c-9d5b-5f4edab634b6 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
49212025-03-25T22:03:49.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0739cde9-a8e1-4564-a6b1-600b1dde524e roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
49222025-03-25T22:03:49.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0739cde9-a8e1-4564-a6b1-600b1dde524e resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
49232025-03-25T22:03:49.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2082 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0739cde9-a8e1-4564-a6b1-600b1dde524e response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
49242025-03-25T22:03:50.843ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
49252025-03-25T22:03:50.843ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
49262025-03-25T22:03:50.843ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
49272025-03-25T22:03:50.843ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
49282025-03-25T22:03:50.843ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
49292025-03-25T22:03:50.843ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
49302025-03-25T22:03:50.843ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
49312025-03-25T22:03:50.843ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
49322025-03-25T22:03:50.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
49332025-03-25T22:03:50.843ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49342025-03-25T22:03:50.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49352025-03-25T22:03:50.843ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
49362025-03-25T22:03:50.843ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
49372025-03-25T22:03:50.843ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49382025-03-25T22:03:50.843ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49392025-03-25T22:03:50.843ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 8 reason = Timeout
49402025-03-25T22:03:50.843ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
49412025-03-25T22:03:50.843ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
49422025-03-25T22:03:50.843ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49432025-03-25T22:03:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
49442025-03-25T22:03:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49452025-03-25T22:03:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
49462025-03-25T22:03:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49472025-03-25T22:03:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
49482025-03-25T22:03:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49492025-03-25T22:03:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
49502025-03-25T22:03:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49512025-03-25T22:03:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49522025-03-25T22:03:50.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
49532025-03-25T22:03:50.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
49542025-03-25T22:03:50.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49552025-03-25T22:03:50.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
49562025-03-25T22:03:50.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
49572025-03-25T22:03:50.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
49582025-03-25T22:03:50.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
49592025-03-25T22:03:50.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
49602025-03-25T22:03:50.844ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
49612025-03-25T22:03:50.844ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 8 reason = Timeout
49622025-03-25T22:03:50.844ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
49632025-03-25T22:03:50.844ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
49642025-03-25T22:03:50.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
49652025-03-25T22:03:50.844ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49662025-03-25T22:03:50.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
49672025-03-25T22:03:50.844ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
49682025-03-25T22:03:50.844ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
49692025-03-25T22:03:50.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49702025-03-25T22:03:50.844ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
49712025-03-25T22:03:50.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
49722025-03-25T22:03:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
49732025-03-25T22:03:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
49742025-03-25T22:03:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
49752025-03-25T22:03:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
49762025-03-25T22:03:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49772025-03-25T22:03:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49782025-03-25T22:03:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49792025-03-25T22:03:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
49802025-03-25T22:03:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
49812025-03-25T22:03:50.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49822025-03-25T22:03:50.846ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6384, tv_nsec: 182482886 } })
49832025-03-25T22:03:50.846ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1171
49842025-03-25T22:03:50.847ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49852025-03-25T22:03:50.847ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6384, tv_nsec: 184322248 } })
49862025-03-25T22:03:50.848ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1171
49872025-03-25T22:03:50.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49882025-03-25T22:03:50.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49892025-03-25T22:03:50.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49902025-03-25T22:03:50.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
49912025-03-25T22:03:50.849ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49922025-03-25T22:03:50.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49932025-03-25T22:03:50.853ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49942025-03-25T22:03:50.855ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
49952025-03-25T22:03:50.855ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49962025-03-25T22:03:50.855ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 12.359246ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
49972025-03-25T22:03:50.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
49982025-03-25T22:03:50.856ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
49992025-03-25T22:03:50.856ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50002025-03-25T22:03:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50012025-03-25T22:03:50.856ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50022025-03-25T22:03:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50032025-03-25T22:03:50.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
50042025-03-25T22:03:50.858ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
50052025-03-25T22:03:50.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
50062025-03-25T22:03:50.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50072025-03-25T22:03:50.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50082025-03-25T22:03:50.859ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 15.142034ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
50092025-03-25T22:03:50.861ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6384, tv_nsec: 197653321 } })
50102025-03-25T22:03:50.861ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1171 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
50112025-03-25T22:03:50.879ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50122025-03-25T22:03:50.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = bfcfbb0a-e869-46b7-ab05-52adb21933a8 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
50132025-03-25T22:03:50.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50142025-03-25T22:03:50.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = bfcfbb0a-e869-46b7-ab05-52adb21933a8 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
50152025-03-25T22:03:50.881ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50162025-03-25T22:03:50.883ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50172025-03-25T22:03:50.883ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3575 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = bfcfbb0a-e869-46b7-ab05-52adb21933a8 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
50182025-03-25T22:03:50.884ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
50192025-03-25T22:03:50.884ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50202025-03-25T22:03:50.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50212025-03-25T22:03:50.886ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
50222025-03-25T22:03:50.886ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
50232025-03-25T22:03:50.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
50242025-03-25T22:03:50.886ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50252025-03-25T22:03:50.890ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
50262025-03-25T22:03:50.890ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50272025-03-25T22:03:50.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50282025-03-25T22:03:50.893ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 48.836543ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
50292025-03-25T22:03:50.903ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50302025-03-25T22:03:50.904ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
50312025-03-25T22:03:50.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
50322025-03-25T22:03:50.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
50332025-03-25T22:03:50.907ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50342025-03-25T22:03:50.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50352025-03-25T22:03:50.909ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50362025-03-25T22:03:50.909ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 66.180976ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
50372025-03-25T22:03:50.911ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50382025-03-25T22:03:50.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50392025-03-25T22:03:50.912ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50402025-03-25T22:03:50.913ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50412025-03-25T22:03:50.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
50422025-03-25T22:03:50.913ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50432025-03-25T22:03:50.913ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50442025-03-25T22:03:50.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50452025-03-25T22:03:50.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50462025-03-25T22:03:50.913ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 69.237289ms iteration = 8 status = {"errors":[],"requests_created_ok":[]}
50472025-03-25T22:03:50.914ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 69.630736ms iteration = 8 status = {"errors":[],"finish_invoked_ok":[]}
50482025-03-25T22:03:50.915ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50492025-03-25T22:03:50.915ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
50502025-03-25T22:03:50.915ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50512025-03-25T22:03:50.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
50522025-03-25T22:03:50.915ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50532025-03-25T22:03:50.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50542025-03-25T22:03:50.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50552025-03-25T22:03:50.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50562025-03-25T22:03:50.916ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50572025-03-25T22:03:50.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50582025-03-25T22:03:50.918ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50592025-03-25T22:03:50.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50602025-03-25T22:03:50.920ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50612025-03-25T22:03:50.920ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
50622025-03-25T22:03:50.920ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50632025-03-25T22:03:50.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50642025-03-25T22:03:50.923ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50652025-03-25T22:03:50.923ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
50662025-03-25T22:03:50.923ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50672025-03-25T22:03:50.923ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50682025-03-25T22:03:50.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50692025-03-25T22:03:50.926ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
50702025-03-25T22:03:50.926ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 81.699207ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
50712025-03-25T22:03:50.930ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
50722025-03-25T22:03:50.930ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50732025-03-25T22:03:50.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50742025-03-25T22:03:50.943ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
50752025-03-25T22:03:50.943ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 100.554097ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
50762025-03-25T22:03:50.947ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
50772025-03-25T22:03:50.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
50782025-03-25T22:03:50.949ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
50792025-03-25T22:03:50.949ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50802025-03-25T22:03:50.950ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9a7f2401-f326-45b4-ae96-bc72d4ac089f", "content-length": "26", "date": "Tue, 25 Mar 2025 22:03:49 GMT"} })
50812025-03-25T22:03:50.950ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50822025-03-25T22:03:50.952ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
50832025-03-25T22:03:50.959ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50842025-03-25T22:03:50.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50852025-03-25T22:03:50.961ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
50862025-03-25T22:03:50.961ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50872025-03-25T22:03:50.961ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bdada2da-7f28-461d-a5e4-921927e82071", "content-length": "26", "date": "Tue, 25 Mar 2025 22:03:50 GMT"} })
50882025-03-25T22:03:50.961ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50892025-03-25T22:03:50.962ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50902025-03-25T22:03:50.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50912025-03-25T22:03:50.962ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 117.92463ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50922025-03-25T22:03:50.964ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
50932025-03-25T22:03:50.965ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 121.095805ms iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
50942025-03-25T22:03:50.965ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50952025-03-25T22:03:50.965ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
50962025-03-25T22:03:50.965ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 121.270389ms iteration = 8 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
50972025-03-25T22:03:50.968ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 zone_address = fd00:1122:3344:101::2
50982025-03-25T22:03:50.968ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50992025-03-25T22:03:50.969ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0aa9ec88-e11d-4978-8cf2-3eabf803df35", "content-length": "26", "date": "Tue, 25 Mar 2025 22:03:50 GMT"} })
51002025-03-25T22:03:50.969ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1184 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51012025-03-25T22:03:50.972ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
51022025-03-25T22:03:50.973ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51032025-03-25T22:03:50.977ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f034aaf6-2037-4cb4-8409-3ab31c15cc28, lookup_type: ById(f034aaf6-2037-4cb4-8409-3ab31c15cc28) } result = Ok(())
51042025-03-25T22:03:50.977ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51052025-03-25T22:03:50.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51062025-03-25T22:03:50.979ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 136.331702ms iteration = 8 status = 0
51072025-03-25T22:03:50.986ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 143.441286ms iteration = 10 status = {"physical_disks_added":0}
51082025-03-25T22:03:50.995ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51092025-03-25T22:03:50.998ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
51102025-03-25T22:03:50.998ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
51112025-03-25T22:03:50.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
51122025-03-25T22:03:51.032ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 188.972141ms iteration = 8 status = {}
51132025-03-25T22:03:51.037ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:360
51142025-03-25T22:03:51.037ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 193.671963ms iteration = 8 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
51152025-03-25T22:03:51.054ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
51162025-03-25T22:03:51.055ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "1042b243-5f31-4595-a8fe-f7b7ff9c8d58", "content-length": "1", "date": "Tue, 25 Mar 2025 22:03:50 GMT"} })
51172025-03-25T22:03:51.056ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
51182025-03-25T22:03:51.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
51192025-03-25T22:03:51.136ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
51202025-03-25T22:03:51.136ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
51212025-03-25T22:03:51.137ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a7b5c994-6d61-4290-a50a-e0fbb22a20e3", "content-length": "372", "date": "Tue, 25 Mar 2025 22:03:51 GMT"} })
51222025-03-25T22:03:51.137ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51232025-03-25T22:03:51.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51242025-03-25T22:03:51.178ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
51252025-03-25T22:03:51.178ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "04d1998a-3488-40fe-a578-48a879c10b2b", "content-length": "691", "date": "Tue, 25 Mar 2025 22:03:51 GMT"} })
51262025-03-25T22:03:51.178ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
51272025-03-25T22:03:51.178ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
51282025-03-25T22:03:51.178ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
51292025-03-25T22:03:51.180ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 336.837873ms iteration = 8 status = {}
51302025-03-25T22:03:51.180ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 337.590467ms iteration = 8 status = null
51312025-03-25T22:03:51.223ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
51322025-03-25T22:03:51.223ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
51332025-03-25T22:03:51.229ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51342025-03-25T22:03:51.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51352025-03-25T22:03:51.231ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a5db250-fa3f-4168-ab16-5c36568c22e2, rack_id: c7210e4b-5a81-4ec8-b8fe-816a9508dc74, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(6d5dda50-e3c4-4853-9bfa-a66b447ab351) } rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
51362025-03-25T22:03:51.231ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51372025-03-25T22:03:51.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51382025-03-25T22:03:51.248ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
51392025-03-25T22:03:51.248ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7fc86f4-3523-4e08-a03e-d6004b3e6928", "content-length": "134", "date": "Tue, 25 Mar 2025 22:03:50 GMT"} })
51402025-03-25T22:03:51.248ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
51412025-03-25T22:03:51.248ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 6d5dda50-e3c4-4853-9bfa-a66b447ab351
51422025-03-25T22:03:51.248ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
51432025-03-25T22:03:51.248ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
51442025-03-25T22:03:51.248ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51452025-03-25T22:03:51.248ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51462025-03-25T22:03:51.248ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51472025-03-25T22:03:51.248ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
51482025-03-25T22:03:51.248ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51492025-03-25T22:03:51.248ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
51502025-03-25T22:03:51.249ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
51512025-03-25T22:03:51.249ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51522025-03-25T22:03:51.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51532025-03-25T22:03:51.251ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
51542025-03-25T22:03:51.252ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "107469b2-3d40-4e64-b9f6-6633ff35cafb", "content-length": "2", "date": "Tue, 25 Mar 2025 22:03:50 GMT"} })
51552025-03-25T22:03:51.252ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
51562025-03-25T22:03:51.252ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d7b0d53-45fc-40e2-814e-2f708de48b0d", "content-length": "52", "date": "Tue, 25 Mar 2025 22:03:50 GMT"} })
51572025-03-25T22:03:51.252ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
51582025-03-25T22:03:51.252ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
51592025-03-25T22:03:51.314ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "60e6eb0d-ac9c-41c2-9edd-35034a83c47c", "date": "Tue, 25 Mar 2025 22:03:51 GMT"} })
51602025-03-25T22:03:51.314ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51612025-03-25T22:03:51.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51622025-03-25T22:03:51.317ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51632025-03-25T22:03:51.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51642025-03-25T22:03:51.321ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51652025-03-25T22:03:51.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51662025-03-25T22:03:51.325ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
51672025-03-25T22:03:51.325ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
51682025-03-25T22:03:51.326ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "54c955e7-9e8a-4a96-8c88-12a55d838af5", "date": "Tue, 25 Mar 2025 22:03:51 GMT"} })
51692025-03-25T22:03:51.327ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 483.309832ms iteration = 8 status = {}
51702025-03-25T22:03:51.409ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1a0e4d5d-e17f-419f-b3d9-853688214ede", "date": "Tue, 25 Mar 2025 22:03:51 GMT"} })
51712025-03-25T22:03:51.409ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch = Switch0
51722025-03-25T22:03:51.409ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
51732025-03-25T22:03:51.414ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b3a7730-fd06-4dd0-8bf8-78264defe8c3", "content-length": "682", "date": "Tue, 25 Mar 2025 22:03:51 GMT"} })
51742025-03-25T22:03:51.414ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51752025-03-25T22:03:51.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51762025-03-25T22:03:51.418ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51772025-03-25T22:03:51.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51782025-03-25T22:03:51.420ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51792025-03-25T22:03:51.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51802025-03-25T22:03:51.422ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51812025-03-25T22:03:51.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51822025-03-25T22:03:51.433ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 590.072538ms iteration = 8 status = {}
51832025-03-25T22:03:51.482ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
51842025-03-25T22:03:51.482ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
51852025-03-25T22:03:51.514ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
51862025-03-25T22:03:51.514ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:39272
51872025-03-25T22:03:51.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:39272 req_id = 2822cdf1-6374-4d9f-bde1-7cc3a78341c5 roles = RoleSet { roles: {} } uri = /metrics/producers
51882025-03-25T22:03:51.515ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:39272 req_id = 2822cdf1-6374-4d9f-bde1-7cc3a78341c5 resource = Database result = Ok(()) uri = /metrics/producers
51892025-03-25T22:03:51.551ZINFOnexus: assigned collector to new producer collector_id = ec539d60-a406-4fe9-a658-fbc8b3fb545b file = nexus/src/app/oximeter.rs:76 producer_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
51902025-03-25T22:03:51.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 36624 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:39272 req_id = 2822cdf1-6374-4d9f-bde1-7cc3a78341c5 response_code = 201 uri = /metrics/producers
51912025-03-25T22:03:51.551ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "2822cdf1-6374-4d9f-bde1-7cc3a78341c5", "content-length": "41", "date": "Tue, 25 Mar 2025 22:03:51 GMT"} })
51922025-03-25T22:03:51.552ZDEBGnexus (producer-registration-task): registered with nexus successfully
51932025-03-25T22:03:51.552ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
51942025-03-25T22:03:51.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 203246d1-afc3-4231-a287-f1aae15b2fb7 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
51952025-03-25T22:03:51.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 203246d1-afc3-4231-a287-f1aae15b2fb7 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
51962025-03-25T22:03:51.916ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2006 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 203246d1-afc3-4231-a287-f1aae15b2fb7 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
51972025-03-25T22:03:52.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 87a3e7fb-ad04-4a6d-a75f-6ed95827d8ea roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
51982025-03-25T22:03:52.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 87a3e7fb-ad04-4a6d-a75f-6ed95827d8ea resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
51992025-03-25T22:03:52.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2021 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 87a3e7fb-ad04-4a6d-a75f-6ed95827d8ea response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52002025-03-25T22:03:53.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b42ff444-5a3c-4c5b-8e72-fda3589f88b8 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52012025-03-25T22:03:53.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b42ff444-5a3c-4c5b-8e72-fda3589f88b8 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52022025-03-25T22:03:53.959ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2315 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b42ff444-5a3c-4c5b-8e72-fda3589f88b8 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52032025-03-25T22:03:54.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4a8c83e6-3e7b-4ee1-8282-154e3ba08425 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52042025-03-25T22:03:54.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4a8c83e6-3e7b-4ee1-8282-154e3ba08425 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52052025-03-25T22:03:54.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2116 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4a8c83e6-3e7b-4ee1-8282-154e3ba08425 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52062025-03-25T22:03:55.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f494e77d-4a3d-4e49-a752-1db87e2587da roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52072025-03-25T22:03:56.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f494e77d-4a3d-4e49-a752-1db87e2587da resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52082025-03-25T22:03:56.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2368 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f494e77d-4a3d-4e49-a752-1db87e2587da response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52092025-03-25T22:03:57.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ad5336f2-0f34-43be-b8fb-7ac58ac75423 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52102025-03-25T22:03:57.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ad5336f2-0f34-43be-b8fb-7ac58ac75423 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52112025-03-25T22:03:57.024ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2151 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ad5336f2-0f34-43be-b8fb-7ac58ac75423 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52122025-03-25T22:03:58.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e95378de-74d3-4b0c-883b-11a8cf4a35b9 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52132025-03-25T22:03:58.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e95378de-74d3-4b0c-883b-11a8cf4a35b9 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52142025-03-25T22:03:58.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2278 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e95378de-74d3-4b0c-883b-11a8cf4a35b9 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52152025-03-25T22:03:58.572ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 550 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = d20dbcd3-dfb0-49c9-89c9-135a3c3a503c response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
52162025-03-25T22:03:59.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 717dc21c-30be-45c3-aaf1-6dbcdb7ac9c0 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52172025-03-25T22:03:59.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 717dc21c-30be-45c3-aaf1-6dbcdb7ac9c0 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52182025-03-25T22:03:59.069ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2413 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 717dc21c-30be-45c3-aaf1-6dbcdb7ac9c0 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52192025-03-25T22:04:00.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b9bbb155-5356-481c-9fde-f0e65b4a9958 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52202025-03-25T22:04:00.089ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b9bbb155-5356-481c-9fde-f0e65b4a9958 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52212025-03-25T22:04:00.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2936 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b9bbb155-5356-481c-9fde-f0e65b4a9958 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52222025-03-25T22:04:00.842ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
52232025-03-25T22:04:00.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52242025-03-25T22:04:00.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52252025-03-25T22:04:00.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
52262025-03-25T22:04:00.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52272025-03-25T22:04:00.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52282025-03-25T22:04:00.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52292025-03-25T22:04:00.845ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52302025-03-25T22:04:00.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52312025-03-25T22:04:00.847ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.246066ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52322025-03-25T22:04:00.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52332025-03-25T22:04:00.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52342025-03-25T22:04:00.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52352025-03-25T22:04:00.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52362025-03-25T22:04:00.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52372025-03-25T22:04:00.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52382025-03-25T22:04:00.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
52392025-03-25T22:04:00.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52402025-03-25T22:04:00.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52412025-03-25T22:04:00.863ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
52422025-03-25T22:04:00.863ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.665961ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
52432025-03-25T22:04:01.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 59525c1f-2e9f-49f9-af6c-c782ea195dbf roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52442025-03-25T22:04:01.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 59525c1f-2e9f-49f9-af6c-c782ea195dbf resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52452025-03-25T22:04:01.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2096 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 59525c1f-2e9f-49f9-af6c-c782ea195dbf response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52462025-03-25T22:04:02.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 58497e49-f078-49f1-9e3d-ae720755da9b roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52472025-03-25T22:04:02.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 58497e49-f078-49f1-9e3d-ae720755da9b resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52482025-03-25T22:04:02.135ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2062 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 58497e49-f078-49f1-9e3d-ae720755da9b response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52492025-03-25T22:04:03.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0a287882-4b9f-44fe-b83f-8c1b7ece4826 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52502025-03-25T22:04:03.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0a287882-4b9f-44fe-b83f-8c1b7ece4826 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52512025-03-25T22:04:03.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2064 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0a287882-4b9f-44fe-b83f-8c1b7ece4826 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52522025-03-25T22:04:04.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7cfbf9cb-522a-4204-9c1d-30059e670412 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52532025-03-25T22:04:04.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7cfbf9cb-522a-4204-9c1d-30059e670412 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52542025-03-25T22:04:04.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2405 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7cfbf9cb-522a-4204-9c1d-30059e670412 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52552025-03-25T22:04:05.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f5ba3904-a59e-47f9-828a-02acf9cb85db roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52562025-03-25T22:04:05.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f5ba3904-a59e-47f9-828a-02acf9cb85db resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52572025-03-25T22:04:05.199ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1836 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f5ba3904-a59e-47f9-828a-02acf9cb85db response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52582025-03-25T22:04:06.219ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 25ee74cb-bc4a-4e07-95bc-739105b07d00 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52592025-03-25T22:04:06.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 25ee74cb-bc4a-4e07-95bc-739105b07d00 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52602025-03-25T22:04:06.221ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2582 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 25ee74cb-bc4a-4e07-95bc-739105b07d00 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52612025-03-25T22:04:07.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7b5d4494-ab84-4b32-8b83-85da03608f1c roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52622025-03-25T22:04:07.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7b5d4494-ab84-4b32-8b83-85da03608f1c resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52632025-03-25T22:04:07.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1731 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7b5d4494-ab84-4b32-8b83-85da03608f1c response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52642025-03-25T22:04:08.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 119219ef-d782-4e13-b513-703fe0fe72d5 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52652025-03-25T22:04:08.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 119219ef-d782-4e13-b513-703fe0fe72d5 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52662025-03-25T22:04:08.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2227 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 119219ef-d782-4e13-b513-703fe0fe72d5 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52672025-03-25T22:04:08.573ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 889 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = cd395075-4918-40c7-99d0-3233e51c4021 response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
52682025-03-25T22:04:09.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = fefe9866-c40b-4402-84b4-9bf87be8bb40 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52692025-03-25T22:04:09.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = fefe9866-c40b-4402-84b4-9bf87be8bb40 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52702025-03-25T22:04:09.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2160 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = fefe9866-c40b-4402-84b4-9bf87be8bb40 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52712025-03-25T22:04:10.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e2f3c758-f88b-4588-8df8-95e5486580cf roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52722025-03-25T22:04:10.307ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e2f3c758-f88b-4588-8df8-95e5486580cf resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52732025-03-25T22:04:10.308ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1801 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e2f3c758-f88b-4588-8df8-95e5486580cf response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52742025-03-25T22:04:10.842ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
52752025-03-25T22:04:10.842ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52762025-03-25T22:04:10.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52772025-03-25T22:04:10.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
52782025-03-25T22:04:10.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52792025-03-25T22:04:10.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52802025-03-25T22:04:10.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52812025-03-25T22:04:10.845ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52822025-03-25T22:04:10.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52832025-03-25T22:04:10.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52842025-03-25T22:04:10.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52852025-03-25T22:04:10.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52862025-03-25T22:04:10.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52872025-03-25T22:04:10.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52882025-03-25T22:04:10.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52892025-03-25T22:04:10.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
52902025-03-25T22:04:10.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52912025-03-25T22:04:10.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52922025-03-25T22:04:10.861ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
52932025-03-25T22:04:10.861ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.861029ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
52942025-03-25T22:04:10.880ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.362025ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52952025-03-25T22:04:11.328ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 64ca7a30-bbcd-4736-9f97-ededb854afa7 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52962025-03-25T22:04:11.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 64ca7a30-bbcd-4736-9f97-ededb854afa7 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52972025-03-25T22:04:11.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2007 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 64ca7a30-bbcd-4736-9f97-ededb854afa7 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52982025-03-25T22:04:12.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 78a4cb21-fcbb-4c01-97e2-166db46d9fb8 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
52992025-03-25T22:04:12.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 78a4cb21-fcbb-4c01-97e2-166db46d9fb8 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
53002025-03-25T22:04:12.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2408 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 78a4cb21-fcbb-4c01-97e2-166db46d9fb8 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
53012025-03-25T22:04:13.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0fd16cc2-057e-4987-b80e-2fdc42d6eaf8 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
53022025-03-25T22:04:13.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0fd16cc2-057e-4987-b80e-2fdc42d6eaf8 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
53032025-03-25T22:04:13.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2203 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0fd16cc2-057e-4987-b80e-2fdc42d6eaf8 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
53042025-03-25T22:04:14.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 28dd3f7f-c715-491f-97c4-7909c2626d0b roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
53052025-03-25T22:04:14.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 28dd3f7f-c715-491f-97c4-7909c2626d0b resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
53062025-03-25T22:04:14.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2007 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 28dd3f7f-c715-491f-97c4-7909c2626d0b response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
53072025-03-25T22:04:15.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b9bac987-06a4-40ef-af3b-2460a8c6cceb roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
53082025-03-25T22:04:15.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b9bac987-06a4-40ef-af3b-2460a8c6cceb resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
53092025-03-25T22:04:15.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2744 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b9bac987-06a4-40ef-af3b-2460a8c6cceb response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
53102025-03-25T22:04:16.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = fedc508c-bf0a-437b-a746-ff41645dd9c3 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
53112025-03-25T22:04:16.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = fedc508c-bf0a-437b-a746-ff41645dd9c3 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
53122025-03-25T22:04:16.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2157 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = fedc508c-bf0a-437b-a746-ff41645dd9c3 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
53132025-03-25T22:04:17.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 29deb1eb-9cb3-4ab9-961a-992c67e02dcf roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
53142025-03-25T22:04:17.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 29deb1eb-9cb3-4ab9-961a-992c67e02dcf resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
53152025-03-25T22:04:17.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2581 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 29deb1eb-9cb3-4ab9-961a-992c67e02dcf response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
53162025-03-25T22:04:18.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6bc1154e-d363-475f-b9cf-e38730cbc43c roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
53172025-03-25T22:04:18.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6bc1154e-d363-475f-b9cf-e38730cbc43c resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
53182025-03-25T22:04:18.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2201 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6bc1154e-d363-475f-b9cf-e38730cbc43c response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
53192025-03-25T22:04:18.573ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 878 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = 2e11fd64-2471-4b2a-a778-8a4edf5ec114 response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
53202025-03-25T22:04:19.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = bab57fe2-7426-48fc-812a-9468500ce07e roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
53212025-03-25T22:04:19.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = bab57fe2-7426-48fc-812a-9468500ce07e resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
53222025-03-25T22:04:19.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1916 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = bab57fe2-7426-48fc-812a-9468500ce07e response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
53232025-03-25T22:04:20.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0ce8b798-78a4-4a28-a87f-ae3703ebd0dd roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
53242025-03-25T22:04:20.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0ce8b798-78a4-4a28-a87f-ae3703ebd0dd resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
53252025-03-25T22:04:20.531ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2684 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0ce8b798-78a4-4a28-a87f-ae3703ebd0dd response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
53262025-03-25T22:04:20.843ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
53272025-03-25T22:04:20.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
53282025-03-25T22:04:20.843ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53292025-03-25T22:04:20.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53302025-03-25T22:04:20.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
53312025-03-25T22:04:20.843ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:82 reason = blueprint disabled target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7
53322025-03-25T22:04:20.843ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 19.981\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7"}
53332025-03-25T22:04:20.843ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
53342025-03-25T22:04:20.843ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
53352025-03-25T22:04:20.843ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
53362025-03-25T22:04:20.843ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-03-25 21:54:20.843388700 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
53372025-03-25T22:04:20.843ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
53382025-03-25T22:04:20.843ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53392025-03-25T22:04:20.843ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
53402025-03-25T22:04:20.843ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
53412025-03-25T22:04:20.843ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
53422025-03-25T22:04:20.843ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
53432025-03-25T22:04:20.843ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53442025-03-25T22:04:20.843ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
53452025-03-25T22:04:20.843ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53462025-03-25T22:04:20.843ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
53472025-03-25T22:04:20.843ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53482025-03-25T22:04:20.843ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
53492025-03-25T22:04:20.843ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
53502025-03-25T22:04:20.843ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
53512025-03-25T22:04:20.843ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53522025-03-25T22:04:20.843ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 9 reason = Timeout
53532025-03-25T22:04:20.843ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
53542025-03-25T22:04:20.843ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
53552025-03-25T22:04:20.843ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
53562025-03-25T22:04:20.843ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53572025-03-25T22:04:20.843ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
53582025-03-25T22:04:20.843ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
53592025-03-25T22:04:20.843ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
53602025-03-25T22:04:20.843ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
53612025-03-25T22:04:20.843ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
53622025-03-25T22:04:20.843ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
53632025-03-25T22:04:20.843ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
53642025-03-25T22:04:20.843ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
53652025-03-25T22:04:20.843ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
53662025-03-25T22:04:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53672025-03-25T22:04:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53682025-03-25T22:04:20.843ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
53692025-03-25T22:04:20.843ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
53702025-03-25T22:04:20.844ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
53712025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
53722025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53732025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53742025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
53752025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
53762025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
53772025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
53782025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
53792025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
53802025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
53812025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
53822025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
53832025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 5 reason = Timeout
53842025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
53852025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53862025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
53872025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 9 reason = Timeout
53882025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
53892025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
53902025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53912025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
53922025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
53932025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53942025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
53952025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
53962025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
53972025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
53982025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53992025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54002025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
54012025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
54022025-03-25T22:04:20.844ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5533f428-2028-4269-b7b1-f15912c01133.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("66b022b6-2e12-413e-b4b7-56c4ad5bdd77.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f337d25b-c67a-4a32-89e1-e187aea97ed9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f337d25b-c67a-4a32-89e1-e187aea97ed9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 6414, tv_nsec: 180604053 } })
54032025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54042025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
54052025-03-25T22:04:20.844ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("58d382a7-99da-40a7-bc9f-2da7e9b156c1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d42076c6-06fe-4102-a978-c7d0a8dffb98.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d42076c6-06fe-4102-a978-c7d0a8dffb98.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 6414, tv_nsec: 180698275 } })
54062025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54072025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
54082025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54092025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
54102025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
54112025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
54122025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
54132025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
54142025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54152025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54162025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
54172025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54182025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
54192025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
54202025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
54212025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.269232ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
54222025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
54232025-03-25T22:04:20.844ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.502396ms iteration = 5 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
54242025-03-25T22:04:20.845ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54252025-03-25T22:04:20.846ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54262025-03-25T22:04:20.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54272025-03-25T22:04:20.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54282025-03-25T22:04:20.846ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54292025-03-25T22:04:20.847ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.694245ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
54302025-03-25T22:04:20.847ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-03-25 21:54:20.843388700 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
54312025-03-25T22:04:20.847ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.428367ms iteration = 5 status = {"expiration":"2025-03-25T21:54:20.843388700Z","pruned":[]}
54322025-03-25T22:04:20.848ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
54332025-03-25T22:04:20.848ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54342025-03-25T22:04:20.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54352025-03-25T22:04:20.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
54362025-03-25T22:04:20.849ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54372025-03-25T22:04:20.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54382025-03-25T22:04:20.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
54392025-03-25T22:04:20.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54402025-03-25T22:04:20.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54412025-03-25T22:04:20.850ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54422025-03-25T22:04:20.850ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54432025-03-25T22:04:20.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54442025-03-25T22:04:20.851ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
54452025-03-25T22:04:20.851ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
54462025-03-25T22:04:20.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
54472025-03-25T22:04:20.852ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54482025-03-25T22:04:20.853ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6414, tv_nsec: 189585490 } })
54492025-03-25T22:04:20.853ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54502025-03-25T22:04:20.853ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1171
54512025-03-25T22:04:20.853ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6414, tv_nsec: 189921876 } })
54522025-03-25T22:04:20.853ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54532025-03-25T22:04:20.853ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1171
54542025-03-25T22:04:20.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
54552025-03-25T22:04:20.853ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54562025-03-25T22:04:20.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54572025-03-25T22:04:20.855ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
54582025-03-25T22:04:20.855ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54592025-03-25T22:04:20.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54602025-03-25T22:04:20.856ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54612025-03-25T22:04:20.857ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
54622025-03-25T22:04:20.857ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54632025-03-25T22:04:20.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54642025-03-25T22:04:20.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
54652025-03-25T22:04:20.857ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
54662025-03-25T22:04:20.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
54672025-03-25T22:04:20.861ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54682025-03-25T22:04:20.863ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 19.263807ms iteration = 9 status = {"errors":[],"requests_created_ok":[]}
54692025-03-25T22:04:20.863ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 19.993939ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
54702025-03-25T22:04:20.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
54712025-03-25T22:04:20.864ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54722025-03-25T22:04:20.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54732025-03-25T22:04:20.866ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54742025-03-25T22:04:20.867ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54752025-03-25T22:04:20.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54762025-03-25T22:04:20.869ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54772025-03-25T22:04:20.869ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54782025-03-25T22:04:20.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54792025-03-25T22:04:20.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54802025-03-25T22:04:20.870ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
54812025-03-25T22:04:20.872ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54822025-03-25T22:04:20.872ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
54832025-03-25T22:04:20.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
54842025-03-25T22:04:20.876ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6414, tv_nsec: 212383349 } })
54852025-03-25T22:04:20.876ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1171 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
54862025-03-25T22:04:20.876ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
54872025-03-25T22:04:20.877ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
54882025-03-25T22:04:20.877ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
54892025-03-25T22:04:20.877ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
54902025-03-25T22:04:20.877ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54912025-03-25T22:04:20.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54922025-03-25T22:04:20.883ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54932025-03-25T22:04:20.886ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54942025-03-25T22:04:20.888ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54952025-03-25T22:04:20.889ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
54962025-03-25T22:04:20.889ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54972025-03-25T22:04:20.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54982025-03-25T22:04:20.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54992025-03-25T22:04:20.891ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
55002025-03-25T22:04:20.891ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55012025-03-25T22:04:20.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55022025-03-25T22:04:20.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55032025-03-25T22:04:20.905ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
55042025-03-25T22:04:20.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55052025-03-25T22:04:20.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55062025-03-25T22:04:20.926ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
55072025-03-25T22:04:20.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
55082025-03-25T22:04:20.928ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 84.242462ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
55092025-03-25T22:04:20.928ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55102025-03-25T22:04:20.928ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
55112025-03-25T22:04:20.928ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
55122025-03-25T22:04:20.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55132025-03-25T22:04:20.928ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 85.087836ms iteration = 5 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
55142025-03-25T22:04:20.930ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
55152025-03-25T22:04:20.930ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 23d93905-7b89-4296-b050-7ff9ae235c15 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
55162025-03-25T22:04:20.930ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55172025-03-25T22:04:20.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55182025-03-25T22:04:20.931ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
55192025-03-25T22:04:20.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
55202025-03-25T22:04:20.932ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
55212025-03-25T22:04:20.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
55222025-03-25T22:04:20.933ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55232025-03-25T22:04:20.933ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55242025-03-25T22:04:20.935ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
55252025-03-25T22:04:20.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
55262025-03-25T22:04:20.937ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
55272025-03-25T22:04:20.937ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
55282025-03-25T22:04:20.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
55292025-03-25T22:04:20.939ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
55302025-03-25T22:04:20.939ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55312025-03-25T22:04:20.939ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55322025-03-25T22:04:20.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55332025-03-25T22:04:20.940ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
55342025-03-25T22:04:20.941ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
55352025-03-25T22:04:20.941ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
55362025-03-25T22:04:20.941ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55372025-03-25T22:04:20.941ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
55382025-03-25T22:04:20.941ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55392025-03-25T22:04:20.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55402025-03-25T22:04:20.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55412025-03-25T22:04:20.947ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 23d93905-7b89-4296-b050-7ff9ae235c15 dns_zone_name = control-plane.oxide.internal found_so_far = 52 version = 1
55422025-03-25T22:04:20.947ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
55432025-03-25T22:04:20.947ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-03-25 22:00:21.368103 UTC dns_group = internal generation = 1
55442025-03-25T22:04:20.947ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 103.874564ms iteration = 5 status = {"generation":1}
55452025-03-25T22:04:20.947ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 103.882755ms iteration = 9 status = {"errors":[],"finish_invoked_ok":[]}
55462025-03-25T22:04:20.949ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55472025-03-25T22:04:20.949ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55482025-03-25T22:04:20.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55492025-03-25T22:04:20.951ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
55502025-03-25T22:04:20.951ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 107.735032ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
55512025-03-25T22:04:20.951ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55522025-03-25T22:04:20.953ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
55532025-03-25T22:04:20.953ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55542025-03-25T22:04:20.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55552025-03-25T22:04:20.955ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
55562025-03-25T22:04:20.955ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
55572025-03-25T22:04:20.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
55582025-03-25T22:04:20.955ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
55592025-03-25T22:04:20.955ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 96679ce4-e18c-487b-803a-7b26be55e85c dns_zone_name = oxide.test found_so_far = 0 version = 2
55602025-03-25T22:04:20.955ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55612025-03-25T22:04:20.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55622025-03-25T22:04:20.957ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
55632025-03-25T22:04:20.957ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
55642025-03-25T22:04:20.957ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
55652025-03-25T22:04:20.957ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55662025-03-25T22:04:20.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
55672025-03-25T22:04:20.960ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55682025-03-25T22:04:20.961ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
55692025-03-25T22:04:20.961ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55702025-03-25T22:04:20.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55712025-03-25T22:04:20.965ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
55722025-03-25T22:04:20.965ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55732025-03-25T22:04:20.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55742025-03-25T22:04:20.966ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55752025-03-25T22:04:20.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55762025-03-25T22:04:20.968ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 96679ce4-e18c-487b-803a-7b26be55e85c dns_zone_name = oxide.test found_so_far = 1 version = 2
55772025-03-25T22:04:20.968ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
55782025-03-25T22:04:20.968ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-03-25 22:00:22.561696 UTC dns_group = external generation = 2
55792025-03-25T22:04:20.968ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 124.989753ms iteration = 5 status = {"generation":2}
55802025-03-25T22:04:20.969ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55812025-03-25T22:04:20.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55822025-03-25T22:04:20.971ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 127.361245ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55832025-03-25T22:04:20.971ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55842025-03-25T22:04:20.972ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55852025-03-25T22:04:20.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55862025-03-25T22:04:20.974ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55872025-03-25T22:04:20.975ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f034aaf6-2037-4cb4-8409-3ab31c15cc28, lookup_type: ById(f034aaf6-2037-4cb4-8409-3ab31c15cc28) } result = Ok(())
55882025-03-25T22:04:20.975ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55892025-03-25T22:04:20.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55902025-03-25T22:04:20.976ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
55912025-03-25T22:04:20.976ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
55922025-03-25T22:04:20.976ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 132.667818ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
55932025-03-25T22:04:20.976ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
55942025-03-25T22:04:20.976ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55952025-03-25T22:04:20.977ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
55962025-03-25T22:04:20.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55972025-03-25T22:04:20.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
55982025-03-25T22:04:20.978ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 134.838896ms iteration = 9 status = 0
55992025-03-25T22:04:20.984ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
56002025-03-25T22:04:20.993ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 150.263435ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
56012025-03-25T22:04:20.996ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 152.353381ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
56022025-03-25T22:04:20.996ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
56032025-03-25T22:04:20.999ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
56042025-03-25T22:04:20.999ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 155.400335ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
56052025-03-25T22:04:21.006ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 162.59724ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
56062025-03-25T22:04:21.014ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
56072025-03-25T22:04:21.014ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
56082025-03-25T22:04:21.014ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 170.55988ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
56092025-03-25T22:04:21.015ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:360
56102025-03-25T22:04:21.015ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 171.649448ms iteration = 9 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
56112025-03-25T22:04:21.019ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
56122025-03-25T22:04:21.019ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
56132025-03-25T22:04:21.020ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8735cfb9-c4af-4c24-87ef-9867ffa9a223", "content-length": "26", "date": "Tue, 25 Mar 2025 22:04:21 GMT"} })
56142025-03-25T22:04:21.020ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
56152025-03-25T22:04:21.021ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
56162025-03-25T22:04:21.025ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-03-25T22:00:16.382271Z, time_modified: 2025-03-25T22:00:16.382271Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, db_silo: Silo { identity: SiloIdentity { id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-25T22:00:22.501108Z, time_modified: 2025-03-25T22:00:22.501108Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, db_silo: Silo { identity: SiloIdentity { id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-25T22:00:22.501108Z, time_modified: 2025-03-25T22:00:22.501108Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d" }] }) }
56172025-03-25T22:04:21.025ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 182.463357ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"5c35ff8c-21dd-48b9-9751-76bfa681bc38","tls_certs":["0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d"]}},"default_endpoint":{"silo_id":"5c35ff8c-21dd-48b9-9751-76bfa681bc38","tls_certs":["0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
56182025-03-25T22:04:21.100ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56192025-03-25T22:04:21.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56202025-03-25T22:04:21.104ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56212025-03-25T22:04:21.106ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
56222025-03-25T22:04:21.106ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56232025-03-25T22:04:21.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56242025-03-25T22:04:21.110ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 267.265128ms iteration = 11 status = {"physical_disks_added":0}
56252025-03-25T22:04:21.125ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
56262025-03-25T22:04:21.125ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
56272025-03-25T22:04:21.130ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b8ae75ad-3d7c-4610-a176-6a19f22a6b79", "content-length": "26", "date": "Tue, 25 Mar 2025 22:04:21 GMT"} })
56282025-03-25T22:04:21.130ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
56292025-03-25T22:04:21.131ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
56302025-03-25T22:04:21.140ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
56312025-03-25T22:04:21.140ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 296.706603ms iteration = 5 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
56322025-03-25T22:04:21.165ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 zone_address = fd00:1122:3344:101::2
56332025-03-25T22:04:21.166ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
56342025-03-25T22:04:21.166ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8aa226d-9275-4a57-b611-7b70df157a8d", "content-length": "26", "date": "Tue, 25 Mar 2025 22:04:21 GMT"} })
56352025-03-25T22:04:21.166ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1184 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
56362025-03-25T22:04:21.166ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
56372025-03-25T22:04:21.168ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
56382025-03-25T22:04:21.187ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
56392025-03-25T22:04:21.188ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "88491310-3a8c-4a67-aa6f-8ac63483cbee", "date": "Tue, 25 Mar 2025 22:04:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
56402025-03-25T22:04:21.188ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
56412025-03-25T22:04:21.190ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "8b1ac4f8-4dd4-40a7-9e22-10585306b19d", "date": "Tue, 25 Mar 2025 22:04:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
56422025-03-25T22:04:21.190ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
56432025-03-25T22:04:21.192ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
56442025-03-25T22:04:21.192ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 348.788723ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
56452025-03-25T22:04:21.248ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
56462025-03-25T22:04:21.249ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4039dfea-2567-455c-a777-9f208ec4ff62", "content-length": "1", "date": "Tue, 25 Mar 2025 22:04:21 GMT"} })
56472025-03-25T22:04:21.250ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
56482025-03-25T22:04:21.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
56492025-03-25T22:04:21.276ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 432.416534ms iteration = 9 status = {}
56502025-03-25T22:04:21.305ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
56512025-03-25T22:04:21.306ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "ce854f35-32f9-43cd-bdf0-1100805f5699", "date": "Tue, 25 Mar 2025 22:04:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
56522025-03-25T22:04:21.306ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
56532025-03-25T22:04:21.307ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "0df44082-8e57-47d9-a89e-d622793a96ea", "date": "Tue, 25 Mar 2025 22:04:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
56542025-03-25T22:04:21.307ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
56552025-03-25T22:04:21.308ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
56562025-03-25T22:04:21.308ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
56572025-03-25T22:04:21.308ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a4acca45-1baf-42bd-8b63-a45c598321c4", "content-length": "372", "date": "Tue, 25 Mar 2025 22:04:21 GMT"} })
56582025-03-25T22:04:21.309ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56592025-03-25T22:04:21.309ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "9045c17b-c0e3-476a-bf59-61a584ce0f6c", "date": "Tue, 25 Mar 2025 22:04:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
56602025-03-25T22:04:21.309ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
56612025-03-25T22:04:21.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56622025-03-25T22:04:21.311ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56632025-03-25T22:04:21.311ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
56642025-03-25T22:04:21.311ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 468.097487ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
56652025-03-25T22:04:21.311ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 468.28711ms iteration = 9 status = null
56662025-03-25T22:04:21.314ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
56672025-03-25T22:04:21.314ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56682025-03-25T22:04:21.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56692025-03-25T22:04:21.381ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
56702025-03-25T22:04:21.381ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
56712025-03-25T22:04:21.381ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "5e99b34e-2d8a-4e20-b7bd-00fb2d7dc7ac", "date": "Tue, 25 Mar 2025 22:04:21 GMT"} })
56722025-03-25T22:04:21.381ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56732025-03-25T22:04:21.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56742025-03-25T22:04:21.384ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56752025-03-25T22:04:21.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56762025-03-25T22:04:21.388ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56772025-03-25T22:04:21.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56782025-03-25T22:04:21.391ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
56792025-03-25T22:04:21.391ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
56802025-03-25T22:04:21.392ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e4f7c6b1-7aab-4df4-8e5b-964b667107c9", "date": "Tue, 25 Mar 2025 22:04:21 GMT"} })
56812025-03-25T22:04:21.394ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 550.470345ms iteration = 9 status = {}
56822025-03-25T22:04:21.395ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56832025-03-25T22:04:21.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56842025-03-25T22:04:21.398ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a5db250-fa3f-4168-ab16-5c36568c22e2, rack_id: c7210e4b-5a81-4ec8-b8fe-816a9508dc74, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(6d5dda50-e3c4-4853-9bfa-a66b447ab351) } rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
56852025-03-25T22:04:21.398ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56862025-03-25T22:04:21.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56872025-03-25T22:04:21.413ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
56882025-03-25T22:04:21.413ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a8e6977c-52d2-46be-b15c-86063fce1cc7", "content-length": "134", "date": "Tue, 25 Mar 2025 22:04:21 GMT"} })
56892025-03-25T22:04:21.413ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
56902025-03-25T22:04:21.413ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 6d5dda50-e3c4-4853-9bfa-a66b447ab351
56912025-03-25T22:04:21.413ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
56922025-03-25T22:04:21.413ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
56932025-03-25T22:04:21.414ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56942025-03-25T22:04:21.414ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56952025-03-25T22:04:21.414ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56962025-03-25T22:04:21.414ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
56972025-03-25T22:04:21.414ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56982025-03-25T22:04:21.414ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
56992025-03-25T22:04:21.414ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
57002025-03-25T22:04:21.414ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57012025-03-25T22:04:21.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57022025-03-25T22:04:21.447ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
57032025-03-25T22:04:21.449ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
57042025-03-25T22:04:21.450ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0feb77c-7a57-440c-beaa-1636ffbc9568", "content-length": "2", "date": "Tue, 25 Mar 2025 22:04:21 GMT"} })
57052025-03-25T22:04:21.450ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
57062025-03-25T22:04:21.450ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "01f462fc-5b0f-495c-a77c-76516ebb5beb", "content-length": "52", "date": "Tue, 25 Mar 2025 22:04:21 GMT"} })
57072025-03-25T22:04:21.450ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
57082025-03-25T22:04:21.450ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
57092025-03-25T22:04:21.528ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c07927d-1ecb-4c97-8e5c-88aa98bf5751", "content-length": "691", "date": "Tue, 25 Mar 2025 22:04:21 GMT"} })
57102025-03-25T22:04:21.528ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
57112025-03-25T22:04:21.528ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
57122025-03-25T22:04:21.528ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
57132025-03-25T22:04:21.530ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 687.387328ms iteration = 9 status = {}
57142025-03-25T22:04:21.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ddb96d39-1044-43f6-a521-cc50ff1dee7a roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
57152025-03-25T22:04:21.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ddb96d39-1044-43f6-a521-cc50ff1dee7a resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
57162025-03-25T22:04:21.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2301 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ddb96d39-1044-43f6-a521-cc50ff1dee7a response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
57172025-03-25T22:04:21.619ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4e39d57c-5c1f-41ed-a558-7daaaaf32055", "date": "Tue, 25 Mar 2025 22:04:21 GMT"} })
57182025-03-25T22:04:21.619ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch = Switch0
57192025-03-25T22:04:21.619ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
57202025-03-25T22:04:21.623ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1017a7a-3046-4cd4-a57c-326a439fc840", "content-length": "682", "date": "Tue, 25 Mar 2025 22:04:21 GMT"} })
57212025-03-25T22:04:21.623ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57222025-03-25T22:04:21.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57232025-03-25T22:04:21.627ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57242025-03-25T22:04:21.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57252025-03-25T22:04:21.631ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57262025-03-25T22:04:21.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57272025-03-25T22:04:21.633ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57282025-03-25T22:04:21.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57292025-03-25T22:04:21.640ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 797.036882ms iteration = 9 status = {}
57302025-03-25T22:04:22.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 379db91a-28d5-4086-814a-a6e545c9cdce roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
57312025-03-25T22:04:22.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 379db91a-28d5-4086-814a-a6e545c9cdce resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
57322025-03-25T22:04:22.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1972 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 379db91a-28d5-4086-814a-a6e545c9cdce response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
57332025-03-25T22:04:23.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = edda893d-c9bd-45a9-89b5-b15d441c7ffc roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
57342025-03-25T22:04:23.597ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = edda893d-c9bd-45a9-89b5-b15d441c7ffc resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
57352025-03-25T22:04:23.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2448 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = edda893d-c9bd-45a9-89b5-b15d441c7ffc response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
57362025-03-25T22:04:24.618ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8cd795fb-91c0-4cb6-9647-0965b6fc9915 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
57372025-03-25T22:04:24.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8cd795fb-91c0-4cb6-9647-0965b6fc9915 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
57382025-03-25T22:04:24.621ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2321 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8cd795fb-91c0-4cb6-9647-0965b6fc9915 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
57392025-03-25T22:04:25.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0d147846-36c0-44cd-b3dd-b0fa0c0c952d roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
57402025-03-25T22:04:25.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0d147846-36c0-44cd-b3dd-b0fa0c0c952d resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
57412025-03-25T22:04:25.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2735 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0d147846-36c0-44cd-b3dd-b0fa0c0c952d response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
57422025-03-25T22:04:26.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2da75635-fad7-4f01-b095-b4e6f44d1012 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
57432025-03-25T22:04:26.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2da75635-fad7-4f01-b095-b4e6f44d1012 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
57442025-03-25T22:04:26.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2022 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2da75635-fad7-4f01-b095-b4e6f44d1012 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
57452025-03-25T22:04:27.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0d602106-9f08-4898-a41d-657255e65b23 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
57462025-03-25T22:04:27.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0d602106-9f08-4898-a41d-657255e65b23 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
57472025-03-25T22:04:27.687ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2216 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0d602106-9f08-4898-a41d-657255e65b23 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
57482025-03-25T22:04:28.572ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 490 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = 47bed1cc-47c3-493f-b5f1-f9af72c20444 response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
57492025-03-25T22:04:28.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7f013123-041b-43d7-9775-a1fbfc395ffb roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
57502025-03-25T22:04:28.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7f013123-041b-43d7-9775-a1fbfc395ffb resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
57512025-03-25T22:04:28.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1576 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7f013123-041b-43d7-9775-a1fbfc395ffb response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
57522025-03-25T22:04:29.727ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3d33b5fb-c188-4491-9bfe-94178c88d2dd roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
57532025-03-25T22:04:29.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3d33b5fb-c188-4491-9bfe-94178c88d2dd resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
57542025-03-25T22:04:29.729ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2180 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3d33b5fb-c188-4491-9bfe-94178c88d2dd response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
57552025-03-25T22:04:30.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 67b95cee-f73e-4e2a-9332-8f143c161e4a roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
57562025-03-25T22:04:30.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 67b95cee-f73e-4e2a-9332-8f143c161e4a resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
57572025-03-25T22:04:30.751ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1953 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 67b95cee-f73e-4e2a-9332-8f143c161e4a response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
57582025-03-25T22:04:30.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
57592025-03-25T22:04:30.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57602025-03-25T22:04:30.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57612025-03-25T22:04:30.843ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
57622025-03-25T22:04:30.843ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57632025-03-25T22:04:30.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57642025-03-25T22:04:30.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57652025-03-25T22:04:30.845ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57662025-03-25T22:04:30.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57672025-03-25T22:04:30.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57682025-03-25T22:04:30.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57692025-03-25T22:04:30.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57702025-03-25T22:04:30.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57712025-03-25T22:04:30.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57722025-03-25T22:04:30.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57732025-03-25T22:04:30.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
57742025-03-25T22:04:30.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57752025-03-25T22:04:30.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57762025-03-25T22:04:30.863ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
57772025-03-25T22:04:30.863ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.63761ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
57782025-03-25T22:04:30.876ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.059768ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57792025-03-25T22:04:31.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 842bb7bc-751e-44b1-9300-a068cf3ef877 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
57802025-03-25T22:04:31.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 842bb7bc-751e-44b1-9300-a068cf3ef877 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
57812025-03-25T22:04:31.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2235 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 842bb7bc-751e-44b1-9300-a068cf3ef877 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
57822025-03-25T22:04:32.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4a33d248-3ab0-4d56-a823-f26cda98a3df roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
57832025-03-25T22:04:32.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4a33d248-3ab0-4d56-a823-f26cda98a3df resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
57842025-03-25T22:04:32.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1927 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4a33d248-3ab0-4d56-a823-f26cda98a3df response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
57852025-03-25T22:04:33.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5bed57f9-e62f-46cf-aedd-bb4c2d841010 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
57862025-03-25T22:04:33.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5bed57f9-e62f-46cf-aedd-bb4c2d841010 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
57872025-03-25T22:04:33.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2345 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5bed57f9-e62f-46cf-aedd-bb4c2d841010 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
57882025-03-25T22:04:34.840ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 60bba00f-4599-4cf8-907c-280bb4f283cd roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
57892025-03-25T22:04:34.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 60bba00f-4599-4cf8-907c-280bb4f283cd resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
57902025-03-25T22:04:34.842ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1790 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 60bba00f-4599-4cf8-907c-280bb4f283cd response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
57912025-03-25T22:04:35.862ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = be37b19d-6573-4c75-8e0d-48d95d46f017 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
57922025-03-25T22:04:35.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = be37b19d-6573-4c75-8e0d-48d95d46f017 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
57932025-03-25T22:04:35.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2255 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = be37b19d-6573-4c75-8e0d-48d95d46f017 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
57942025-03-25T22:04:36.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b8a40b81-4bbe-48ab-9323-a96b79fd3ada roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
57952025-03-25T22:04:36.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b8a40b81-4bbe-48ab-9323-a96b79fd3ada resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
57962025-03-25T22:04:36.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2106 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b8a40b81-4bbe-48ab-9323-a96b79fd3ada response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
57972025-03-25T22:04:37.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c8d2be0c-c4f0-45ee-ad9e-8d7951d5b8be roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
57982025-03-25T22:04:37.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c8d2be0c-c4f0-45ee-ad9e-8d7951d5b8be resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
57992025-03-25T22:04:37.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1923 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c8d2be0c-c4f0-45ee-ad9e-8d7951d5b8be response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
58002025-03-25T22:04:38.572ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 701 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = 0c307a02-cf26-4984-b5dc-7cfcbd57363b response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
58012025-03-25T22:04:38.928ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 22097b5c-0613-4851-9841-e79f5a115e36 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
58022025-03-25T22:04:38.929ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 22097b5c-0613-4851-9841-e79f5a115e36 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
58032025-03-25T22:04:38.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2104 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 22097b5c-0613-4851-9841-e79f5a115e36 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
58042025-03-25T22:04:39.951ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c04f274e-7002-4cf8-a0f4-73c054d3e19f roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
58052025-03-25T22:04:39.951ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c04f274e-7002-4cf8-a0f4-73c054d3e19f resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
58062025-03-25T22:04:39.953ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2333 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c04f274e-7002-4cf8-a0f4-73c054d3e19f response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
58072025-03-25T22:04:40.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
58082025-03-25T22:04:40.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58092025-03-25T22:04:40.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58102025-03-25T22:04:40.843ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
58112025-03-25T22:04:40.843ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58122025-03-25T22:04:40.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58132025-03-25T22:04:40.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58142025-03-25T22:04:40.845ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58152025-03-25T22:04:40.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58162025-03-25T22:04:40.847ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.612293ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
58172025-03-25T22:04:40.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58182025-03-25T22:04:40.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58192025-03-25T22:04:40.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58202025-03-25T22:04:40.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58212025-03-25T22:04:40.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58222025-03-25T22:04:40.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58232025-03-25T22:04:40.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
58242025-03-25T22:04:40.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58252025-03-25T22:04:40.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58262025-03-25T22:04:40.860ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
58272025-03-25T22:04:40.860ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.280682ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
58282025-03-25T22:04:40.972ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0be47578-4f0c-4a05-a08b-bee073c948c0 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
58292025-03-25T22:04:40.973ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0be47578-4f0c-4a05-a08b-bee073c948c0 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
58302025-03-25T22:04:40.974ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2260 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0be47578-4f0c-4a05-a08b-bee073c948c0 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
58312025-03-25T22:04:41.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 656c5dfe-a077-4462-8c2e-c827d5abe387 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
58322025-03-25T22:04:41.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 656c5dfe-a077-4462-8c2e-c827d5abe387 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
58332025-03-25T22:04:41.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1641 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 656c5dfe-a077-4462-8c2e-c827d5abe387 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
58342025-03-25T22:04:43.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 91ab2b43-e299-4ad1-80eb-0f6f527ded7d roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
58352025-03-25T22:04:43.015ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 91ab2b43-e299-4ad1-80eb-0f6f527ded7d resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
58362025-03-25T22:04:43.017ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2196 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 91ab2b43-e299-4ad1-80eb-0f6f527ded7d response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
58372025-03-25T22:04:43.565ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:38741
58382025-03-25T22:04:43.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38741 req_id = 7deed926-9f86-4811-a025-a93a1612f506 roles = RoleSet { roles: {} } uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
58392025-03-25T22:04:43.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38741 req_id = 7deed926-9f86-4811-a025-a93a1612f506 resource = Database result = Ok(()) uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
58402025-03-25T22:04:43.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2410 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38741 req_id = 7deed926-9f86-4811-a025-a93a1612f506 response_code = 200 uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
58412025-03-25T22:04:43.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38741 req_id = fc74b3fd-fb9b-4319-9af8-957058c18ecf roles = RoleSet { roles: {} } uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
58422025-03-25T22:04:43.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38741 req_id = fc74b3fd-fb9b-4319-9af8-957058c18ecf resource = Database result = Ok(()) uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
58432025-03-25T22:04:43.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2391 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38741 req_id = fc74b3fd-fb9b-4319-9af8-957058c18ecf response_code = 200 uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
58442025-03-25T22:04:44.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6969dfe0-d15e-4795-9fc0-ca25c4828fcf roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
58452025-03-25T22:04:44.038ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6969dfe0-d15e-4795-9fc0-ca25c4828fcf resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
58462025-03-25T22:04:44.040ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2294 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6969dfe0-d15e-4795-9fc0-ca25c4828fcf response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
58472025-03-25T22:04:45.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 224c385c-8c74-4436-8451-e4118880e3fd roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
58482025-03-25T22:04:45.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 224c385c-8c74-4436-8451-e4118880e3fd resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
58492025-03-25T22:04:45.061ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1866 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 224c385c-8c74-4436-8451-e4118880e3fd response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
58502025-03-25T22:04:46.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8c72e8fa-c9e0-4c2b-8db2-b5c06dc11209 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
58512025-03-25T22:04:46.080ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8c72e8fa-c9e0-4c2b-8db2-b5c06dc11209 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
58522025-03-25T22:04:46.082ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2336 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8c72e8fa-c9e0-4c2b-8db2-b5c06dc11209 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
58532025-03-25T22:04:47.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1ea5e5d9-1c7f-4f58-994f-f5fd1addbddf roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
58542025-03-25T22:04:47.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1ea5e5d9-1c7f-4f58-994f-f5fd1addbddf resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
58552025-03-25T22:04:47.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2553 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1ea5e5d9-1c7f-4f58-994f-f5fd1addbddf response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
58562025-03-25T22:04:48.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c10086dc-4960-4d75-b458-675d040d50e7 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
58572025-03-25T22:04:48.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c10086dc-4960-4d75-b458-675d040d50e7 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
58582025-03-25T22:04:48.125ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2081 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c10086dc-4960-4d75-b458-675d040d50e7 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
58592025-03-25T22:04:48.572ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 516 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = 26e61ae5-cb3a-43fc-8178-995e4b9bbdd8 response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
58602025-03-25T22:04:49.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ed002517-a218-4996-8caf-3fa93cfeab16 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
58612025-03-25T22:04:49.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ed002517-a218-4996-8caf-3fa93cfeab16 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
58622025-03-25T22:04:49.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2193 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ed002517-a218-4996-8caf-3fa93cfeab16 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
58632025-03-25T22:04:50.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0158f30e-58e6-4b8d-a35c-765aa6caef87 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
58642025-03-25T22:04:50.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0158f30e-58e6-4b8d-a35c-765aa6caef87 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
58652025-03-25T22:04:50.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2076 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0158f30e-58e6-4b8d-a35c-765aa6caef87 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
58662025-03-25T22:04:50.843ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
58672025-03-25T22:04:50.843ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58682025-03-25T22:04:50.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
58692025-03-25T22:04:50.843ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
58702025-03-25T22:04:50.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58712025-03-25T22:04:50.843ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
58722025-03-25T22:04:50.843ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
58732025-03-25T22:04:50.843ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58742025-03-25T22:04:50.843ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 10 reason = Timeout
58752025-03-25T22:04:50.843ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
58762025-03-25T22:04:50.843ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
58772025-03-25T22:04:50.843ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
58782025-03-25T22:04:50.843ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
58792025-03-25T22:04:50.843ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
58802025-03-25T22:04:50.843ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58812025-03-25T22:04:50.843ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58822025-03-25T22:04:50.843ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
58832025-03-25T22:04:50.843ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
58842025-03-25T22:04:50.843ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
58852025-03-25T22:04:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58862025-03-25T22:04:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
58872025-03-25T22:04:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58882025-03-25T22:04:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
58892025-03-25T22:04:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58902025-03-25T22:04:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58912025-03-25T22:04:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58922025-03-25T22:04:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
58932025-03-25T22:04:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
58942025-03-25T22:04:50.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
58952025-03-25T22:04:50.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
58962025-03-25T22:04:50.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
58972025-03-25T22:04:50.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58982025-03-25T22:04:50.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
58992025-03-25T22:04:50.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
59002025-03-25T22:04:50.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
59012025-03-25T22:04:50.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
59022025-03-25T22:04:50.844ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 10 reason = Timeout
59032025-03-25T22:04:50.844ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
59042025-03-25T22:04:50.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
59052025-03-25T22:04:50.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
59062025-03-25T22:04:50.844ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
59072025-03-25T22:04:50.844ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
59082025-03-25T22:04:50.844ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
59092025-03-25T22:04:50.844ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59102025-03-25T22:04:50.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
59112025-03-25T22:04:50.844ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
59122025-03-25T22:04:50.844ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
59132025-03-25T22:04:50.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
59142025-03-25T22:04:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
59152025-03-25T22:04:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
59162025-03-25T22:04:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
59172025-03-25T22:04:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
59182025-03-25T22:04:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
59192025-03-25T22:04:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59202025-03-25T22:04:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
59212025-03-25T22:04:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59222025-03-25T22:04:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
59232025-03-25T22:04:50.847ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.668214ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
59242025-03-25T22:04:50.847ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59252025-03-25T22:04:50.847ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59262025-03-25T22:04:50.847ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6444, tv_nsec: 183966092 } })
59272025-03-25T22:04:50.847ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1171
59282025-03-25T22:04:50.849ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
59292025-03-25T22:04:50.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
59302025-03-25T22:04:50.849ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6444, tv_nsec: 185869735 } })
59312025-03-25T22:04:50.849ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1171
59322025-03-25T22:04:50.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
59332025-03-25T22:04:50.849ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59342025-03-25T22:04:50.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
59352025-03-25T22:04:50.850ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59362025-03-25T22:04:50.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59372025-03-25T22:04:50.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59382025-03-25T22:04:50.851ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 7.257337ms iteration = 10 status = {"errors":[],"finish_invoked_ok":[]}
59392025-03-25T22:04:50.852ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 7.562522ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
59402025-03-25T22:04:50.855ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59412025-03-25T22:04:50.855ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 10.679427ms iteration = 10 status = {"errors":[],"requests_created_ok":[]}
59422025-03-25T22:04:50.855ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59432025-03-25T22:04:50.856ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
59442025-03-25T22:04:50.856ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
59452025-03-25T22:04:50.856ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
59462025-03-25T22:04:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
59472025-03-25T22:04:50.857ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59482025-03-25T22:04:50.857ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6444, tv_nsec: 193912366 } })
59492025-03-25T22:04:50.857ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
59502025-03-25T22:04:50.857ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59512025-03-25T22:04:50.857ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1171 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
59522025-03-25T22:04:50.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59532025-03-25T22:04:50.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59542025-03-25T22:04:50.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
59552025-03-25T22:04:50.858ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
59562025-03-25T22:04:50.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
59572025-03-25T22:04:50.859ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59582025-03-25T22:04:50.860ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
59592025-03-25T22:04:50.860ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
59602025-03-25T22:04:50.860ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
59612025-03-25T22:04:50.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
59622025-03-25T22:04:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
59632025-03-25T22:04:50.862ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59642025-03-25T22:04:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59652025-03-25T22:04:50.905ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59662025-03-25T22:04:50.906ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59672025-03-25T22:04:50.909ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
59682025-03-25T22:04:50.909ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
59692025-03-25T22:04:50.909ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
59702025-03-25T22:04:50.909ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59712025-03-25T22:04:50.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59722025-03-25T22:04:50.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
59732025-03-25T22:04:50.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59742025-03-25T22:04:50.912ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59752025-03-25T22:04:50.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59762025-03-25T22:04:50.913ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
59772025-03-25T22:04:50.913ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59782025-03-25T22:04:50.914ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7283d837-e2ba-4101-8b8a-4ad2fbbdb3de", "content-length": "26", "date": "Tue, 25 Mar 2025 22:04:50 GMT"} })
59792025-03-25T22:04:50.914ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59802025-03-25T22:04:50.914ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
59812025-03-25T22:04:50.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
59822025-03-25T22:04:50.914ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59832025-03-25T22:04:50.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59842025-03-25T22:04:50.915ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 71.858025ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
59852025-03-25T22:04:50.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
59862025-03-25T22:04:50.916ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59872025-03-25T22:04:50.916ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
59882025-03-25T22:04:50.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59892025-03-25T22:04:50.919ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
59902025-03-25T22:04:50.919ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59912025-03-25T22:04:50.919ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f41a306e-f922-46a7-9174-8f0426d5c8c8", "content-length": "26", "date": "Tue, 25 Mar 2025 22:04:50 GMT"} })
59922025-03-25T22:04:50.919ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59932025-03-25T22:04:50.919ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59942025-03-25T22:04:50.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59952025-03-25T22:04:50.920ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
59962025-03-25T22:04:50.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
59972025-03-25T22:04:50.921ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
59982025-03-25T22:04:50.922ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59992025-03-25T22:04:50.924ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60002025-03-25T22:04:50.925ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 zone_address = fd00:1122:3344:101::2
60012025-03-25T22:04:50.925ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
60022025-03-25T22:04:50.926ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "96b1a45f-4d78-49cc-a750-a754e36eca9d", "content-length": "26", "date": "Tue, 25 Mar 2025 22:04:50 GMT"} })
60032025-03-25T22:04:50.926ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1184 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
60042025-03-25T22:04:50.926ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
60052025-03-25T22:04:50.926ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60062025-03-25T22:04:50.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60072025-03-25T22:04:50.927ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
60082025-03-25T22:04:50.927ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 82.373599ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
60092025-03-25T22:04:50.927ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
60102025-03-25T22:04:50.927ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60112025-03-25T22:04:50.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60122025-03-25T22:04:50.928ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
60132025-03-25T22:04:50.928ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
60142025-03-25T22:04:50.928ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
60152025-03-25T22:04:50.928ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 84.140749ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
60162025-03-25T22:04:50.950ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 107.228933ms iteration = 12 status = {"physical_disks_added":0}
60172025-03-25T22:04:50.950ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
60182025-03-25T22:04:50.950ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 107.59337ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
60192025-03-25T22:04:50.953ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60202025-03-25T22:04:50.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60212025-03-25T22:04:50.962ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60222025-03-25T22:04:50.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60232025-03-25T22:04:50.965ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60242025-03-25T22:04:50.966ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 122.016602ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60252025-03-25T22:04:50.968ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f034aaf6-2037-4cb4-8409-3ab31c15cc28, lookup_type: ById(f034aaf6-2037-4cb4-8409-3ab31c15cc28) } result = Ok(())
60262025-03-25T22:04:50.969ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60272025-03-25T22:04:50.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60282025-03-25T22:04:50.970ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
60292025-03-25T22:04:50.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
60302025-03-25T22:04:50.971ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
60312025-03-25T22:04:50.971ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 127.943385ms iteration = 10 status = 0
60322025-03-25T22:04:50.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
60332025-03-25T22:04:50.972ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 128.387913ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
60342025-03-25T22:04:50.973ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60352025-03-25T22:04:50.975ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
60362025-03-25T22:04:50.975ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
60372025-03-25T22:04:50.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
60382025-03-25T22:04:50.976ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:360
60392025-03-25T22:04:50.976ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 133.110495ms iteration = 10 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
60402025-03-25T22:04:51.000ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60412025-03-25T22:04:51.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60422025-03-25T22:04:51.001ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 156.726928ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
60432025-03-25T22:04:51.021ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 178.341595ms iteration = 10 status = {}
60442025-03-25T22:04:51.023ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
60452025-03-25T22:04:51.023ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "90e3572e-0381-4a5f-9a4d-04574fda51af", "content-length": "1", "date": "Tue, 25 Mar 2025 22:04:50 GMT"} })
60462025-03-25T22:04:51.025ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
60472025-03-25T22:04:51.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
60482025-03-25T22:04:51.028ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 184.773328ms iteration = 10 status = null
60492025-03-25T22:04:51.038ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60502025-03-25T22:04:51.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60512025-03-25T22:04:51.040ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60522025-03-25T22:04:51.043ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
60532025-03-25T22:04:51.043ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60542025-03-25T22:04:51.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60552025-03-25T22:04:51.108ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
60562025-03-25T22:04:51.108ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
60572025-03-25T22:04:51.109ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "89f7f6cb-6582-4fa9-898e-af53395f9c96", "content-length": "372", "date": "Tue, 25 Mar 2025 22:04:51 GMT"} })
60582025-03-25T22:04:51.109ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60592025-03-25T22:04:51.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60602025-03-25T22:04:51.110ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60612025-03-25T22:04:51.112ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
60622025-03-25T22:04:51.112ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60632025-03-25T22:04:51.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60642025-03-25T22:04:51.130ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60652025-03-25T22:04:51.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60662025-03-25T22:04:51.132ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
60672025-03-25T22:04:51.132ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
60682025-03-25T22:04:51.132ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a5db250-fa3f-4168-ab16-5c36568c22e2, rack_id: c7210e4b-5a81-4ec8-b8fe-816a9508dc74, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(6d5dda50-e3c4-4853-9bfa-a66b447ab351) } rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
60692025-03-25T22:04:51.132ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a4026b95-63f1-4902-9754-9273af68d1b4", "date": "Tue, 25 Mar 2025 22:04:51 GMT"} })
60702025-03-25T22:04:51.132ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60712025-03-25T22:04:51.132ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60722025-03-25T22:04:51.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60732025-03-25T22:04:51.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60742025-03-25T22:04:51.135ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60752025-03-25T22:04:51.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60762025-03-25T22:04:51.139ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60772025-03-25T22:04:51.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60782025-03-25T22:04:51.144ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
60792025-03-25T22:04:51.144ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
60802025-03-25T22:04:51.145ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ac52a965-8bdf-42c8-8a11-73711a32c5eb", "date": "Tue, 25 Mar 2025 22:04:51 GMT"} })
60812025-03-25T22:04:51.147ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 302.847761ms iteration = 10 status = {}
60822025-03-25T22:04:51.153ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
60832025-03-25T22:04:51.153ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "1516d10c-4e73-4608-b8c6-e2a734d22684", "content-length": "134", "date": "Tue, 25 Mar 2025 22:04:50 GMT"} })
60842025-03-25T22:04:51.153ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
60852025-03-25T22:04:51.154ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 6d5dda50-e3c4-4853-9bfa-a66b447ab351
60862025-03-25T22:04:51.154ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
60872025-03-25T22:04:51.154ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
60882025-03-25T22:04:51.154ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60892025-03-25T22:04:51.154ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60902025-03-25T22:04:51.154ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60912025-03-25T22:04:51.154ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
60922025-03-25T22:04:51.154ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60932025-03-25T22:04:51.154ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
60942025-03-25T22:04:51.154ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
60952025-03-25T22:04:51.154ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60962025-03-25T22:04:51.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60972025-03-25T22:04:51.157ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
60982025-03-25T22:04:51.157ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "53d818b6-91f2-44d2-a635-8d280fc8829f", "content-length": "2", "date": "Tue, 25 Mar 2025 22:04:50 GMT"} })
60992025-03-25T22:04:51.157ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
61002025-03-25T22:04:51.157ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b108a328-dfb0-46b9-b3dc-c4e74f801294", "content-length": "52", "date": "Tue, 25 Mar 2025 22:04:50 GMT"} })
61012025-03-25T22:04:51.157ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
61022025-03-25T22:04:51.157ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
61032025-03-25T22:04:51.239ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
61042025-03-25T22:04:51.278ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "11cd471c-4c3f-4d11-a02f-60d41b3b41f0", "date": "Tue, 25 Mar 2025 22:04:51 GMT"} })
61052025-03-25T22:04:51.278ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch = Switch0
61062025-03-25T22:04:51.278ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
61072025-03-25T22:04:51.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c3db0eae-70aa-467f-ad36-032fd05aa701 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61082025-03-25T22:04:51.278ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e779595-8661-42a6-93ca-465d91033f94", "content-length": "682", "date": "Tue, 25 Mar 2025 22:04:51 GMT"} })
61092025-03-25T22:04:51.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c3db0eae-70aa-467f-ad36-032fd05aa701 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61102025-03-25T22:04:51.278ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61112025-03-25T22:04:51.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61122025-03-25T22:04:51.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2570 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c3db0eae-70aa-467f-ad36-032fd05aa701 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61132025-03-25T22:04:51.283ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61142025-03-25T22:04:51.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61152025-03-25T22:04:51.287ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61162025-03-25T22:04:51.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61172025-03-25T22:04:51.288ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "40a05fe0-dcbf-4f44-b9cd-a1ebfe8e628d", "content-length": "691", "date": "Tue, 25 Mar 2025 22:04:51 GMT"} })
61182025-03-25T22:04:51.288ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
61192025-03-25T22:04:51.288ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
61202025-03-25T22:04:51.288ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
61212025-03-25T22:04:51.289ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61222025-03-25T22:04:51.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61232025-03-25T22:04:51.290ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 447.241853ms iteration = 10 status = {}
61242025-03-25T22:04:51.297ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 453.797837ms iteration = 10 status = {}
61252025-03-25T22:04:52.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1eb0a637-abf7-41c9-898e-74748808ba36 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61262025-03-25T22:04:52.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1eb0a637-abf7-41c9-898e-74748808ba36 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61272025-03-25T22:04:52.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2009 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1eb0a637-abf7-41c9-898e-74748808ba36 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61282025-03-25T22:04:53.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d18db1d7-27fb-4a3a-bb3c-6d5b7743dc07 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61292025-03-25T22:04:53.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d18db1d7-27fb-4a3a-bb3c-6d5b7743dc07 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61302025-03-25T22:04:53.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2099 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d18db1d7-27fb-4a3a-bb3c-6d5b7743dc07 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61312025-03-25T22:04:54.347ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = cb28034e-f4bd-481d-9cb4-ce6a7d279d55 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61322025-03-25T22:04:54.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = cb28034e-f4bd-481d-9cb4-ce6a7d279d55 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61332025-03-25T22:04:54.349ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2180 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = cb28034e-f4bd-481d-9cb4-ce6a7d279d55 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61342025-03-25T22:04:55.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 931e240e-8817-4c8e-98ac-6d0dd5f84f2d roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61352025-03-25T22:04:55.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 931e240e-8817-4c8e-98ac-6d0dd5f84f2d resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61362025-03-25T22:04:55.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2113 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 931e240e-8817-4c8e-98ac-6d0dd5f84f2d response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61372025-03-25T22:04:56.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f632dc97-7128-4c2c-ab49-c8d60d8dd0f8 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61382025-03-25T22:04:56.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f632dc97-7128-4c2c-ab49-c8d60d8dd0f8 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61392025-03-25T22:04:56.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2050 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f632dc97-7128-4c2c-ab49-c8d60d8dd0f8 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61402025-03-25T22:04:57.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0e00602e-ed67-43b1-a1d5-462b8ae2df8f roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61412025-03-25T22:04:57.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0e00602e-ed67-43b1-a1d5-462b8ae2df8f resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61422025-03-25T22:04:57.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2150 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0e00602e-ed67-43b1-a1d5-462b8ae2df8f response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61432025-03-25T22:04:58.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 26ee6a93-3b7f-4281-9fa2-56c40c195aed roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61442025-03-25T22:04:58.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 26ee6a93-3b7f-4281-9fa2-56c40c195aed resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61452025-03-25T22:04:58.439ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2049 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 26ee6a93-3b7f-4281-9fa2-56c40c195aed response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61462025-03-25T22:04:58.573ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 480 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = fbbc44f7-1284-4125-a6f5-f82a2a128d70 response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
61472025-03-25T22:04:59.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ce256e2d-9454-4b3f-832e-e394b19356d4 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61482025-03-25T22:04:59.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ce256e2d-9454-4b3f-832e-e394b19356d4 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61492025-03-25T22:04:59.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2123 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ce256e2d-9454-4b3f-832e-e394b19356d4 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61502025-03-25T22:05:00.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6488de9b-36ed-431b-9b4e-898827706c56 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61512025-03-25T22:05:00.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6488de9b-36ed-431b-9b4e-898827706c56 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61522025-03-25T22:05:00.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2180 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6488de9b-36ed-431b-9b4e-898827706c56 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61532025-03-25T22:05:00.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
61542025-03-25T22:05:00.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61552025-03-25T22:05:00.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61562025-03-25T22:05:00.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
61572025-03-25T22:05:00.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61582025-03-25T22:05:00.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61592025-03-25T22:05:00.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61602025-03-25T22:05:00.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61612025-03-25T22:05:00.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61622025-03-25T22:05:00.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61632025-03-25T22:05:00.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61642025-03-25T22:05:00.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61652025-03-25T22:05:00.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61662025-03-25T22:05:00.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
61672025-03-25T22:05:00.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61682025-03-25T22:05:00.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61692025-03-25T22:05:00.863ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
61702025-03-25T22:05:00.863ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.339235ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
61712025-03-25T22:05:00.880ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61722025-03-25T22:05:00.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61732025-03-25T22:05:00.882ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 38.386471ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61742025-03-25T22:05:01.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 71964d28-4ee1-40a3-bb30-315a37490f16 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61752025-03-25T22:05:01.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 71964d28-4ee1-40a3-bb30-315a37490f16 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61762025-03-25T22:05:01.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1964 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 71964d28-4ee1-40a3-bb30-315a37490f16 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61772025-03-25T22:05:02.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d8fc51c9-475e-4108-b25b-b5ff3cc3ade6 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61782025-03-25T22:05:02.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d8fc51c9-475e-4108-b25b-b5ff3cc3ade6 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61792025-03-25T22:05:02.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2540 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d8fc51c9-475e-4108-b25b-b5ff3cc3ade6 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61802025-03-25T22:05:03.548ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0ec1dc14-5fa6-4b7c-924a-1e3c44c2088b roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61812025-03-25T22:05:03.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0ec1dc14-5fa6-4b7c-924a-1e3c44c2088b resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61822025-03-25T22:05:03.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2482 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0ec1dc14-5fa6-4b7c-924a-1e3c44c2088b response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61832025-03-25T22:05:04.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e23608cd-4b1a-4fcd-8ba8-3daa5d96c848 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61842025-03-25T22:05:04.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e23608cd-4b1a-4fcd-8ba8-3daa5d96c848 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61852025-03-25T22:05:04.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2090 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e23608cd-4b1a-4fcd-8ba8-3daa5d96c848 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61862025-03-25T22:05:05.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2816effa-0102-44b5-8903-d2d20eeec925 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61872025-03-25T22:05:05.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2816effa-0102-44b5-8903-d2d20eeec925 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61882025-03-25T22:05:05.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2614 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2816effa-0102-44b5-8903-d2d20eeec925 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61892025-03-25T22:05:06.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = bd0dc886-e21d-47f8-a91d-68fbc6e06e5d roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61902025-03-25T22:05:06.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = bd0dc886-e21d-47f8-a91d-68fbc6e06e5d resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61912025-03-25T22:05:06.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2234 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = bd0dc886-e21d-47f8-a91d-68fbc6e06e5d response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61922025-03-25T22:05:07.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6a04ad78-7008-4e1c-9df8-b95599382009 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61932025-03-25T22:05:07.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6a04ad78-7008-4e1c-9df8-b95599382009 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61942025-03-25T22:05:07.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2121 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6a04ad78-7008-4e1c-9df8-b95599382009 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61952025-03-25T22:05:08.572ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 464 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = f52c7fd1-8996-4788-b488-716ff6ecc2b1 response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
61962025-03-25T22:05:08.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 430f8a08-ac39-4cd7-8ee7-d049ec55dfe2 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61972025-03-25T22:05:08.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 430f8a08-ac39-4cd7-8ee7-d049ec55dfe2 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61982025-03-25T22:05:08.660ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2400 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 430f8a08-ac39-4cd7-8ee7-d049ec55dfe2 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
61992025-03-25T22:05:09.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f2725df1-b110-4f2c-b134-084a9d7643e7 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
62002025-03-25T22:05:09.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f2725df1-b110-4f2c-b134-084a9d7643e7 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
62012025-03-25T22:05:09.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1744 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f2725df1-b110-4f2c-b134-084a9d7643e7 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
62022025-03-25T22:05:10.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 43366804-7396-4994-8903-7e92221b275e roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
62032025-03-25T22:05:10.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 43366804-7396-4994-8903-7e92221b275e resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
62042025-03-25T22:05:10.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1839 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 43366804-7396-4994-8903-7e92221b275e response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
62052025-03-25T22:05:10.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
62062025-03-25T22:05:10.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62072025-03-25T22:05:10.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62082025-03-25T22:05:10.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
62092025-03-25T22:05:10.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62102025-03-25T22:05:10.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62112025-03-25T22:05:10.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62122025-03-25T22:05:10.846ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62132025-03-25T22:05:10.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62142025-03-25T22:05:10.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
62152025-03-25T22:05:10.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62162025-03-25T22:05:10.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62172025-03-25T22:05:10.848ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.150843ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
62182025-03-25T22:05:10.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62192025-03-25T22:05:10.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62202025-03-25T22:05:10.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62212025-03-25T22:05:10.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
62222025-03-25T22:05:10.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62232025-03-25T22:05:10.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62242025-03-25T22:05:10.867ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
62252025-03-25T22:05:10.867ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.825944ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
62262025-03-25T22:05:11.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 36a03615-93d4-49ec-a076-7c8994704b88 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
62272025-03-25T22:05:11.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 36a03615-93d4-49ec-a076-7c8994704b88 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
62282025-03-25T22:05:11.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2240 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 36a03615-93d4-49ec-a076-7c8994704b88 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
62292025-03-25T22:05:12.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 14c7b3be-609b-4dbb-aed7-2f9036ca0bb2 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
62302025-03-25T22:05:12.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 14c7b3be-609b-4dbb-aed7-2f9036ca0bb2 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
62312025-03-25T22:05:12.747ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2373 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 14c7b3be-609b-4dbb-aed7-2f9036ca0bb2 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
62322025-03-25T22:05:13.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38741 req_id = aaef9558-99c7-4efa-b899-cc04196ca282 roles = RoleSet { roles: {} } uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
62332025-03-25T22:05:13.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38741 req_id = aaef9558-99c7-4efa-b899-cc04196ca282 resource = Database result = Ok(()) uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
62342025-03-25T22:05:13.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2949 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38741 req_id = aaef9558-99c7-4efa-b899-cc04196ca282 response_code = 200 uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
62352025-03-25T22:05:13.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38741 req_id = 624689e6-c069-49d6-8211-2081de9173ba roles = RoleSet { roles: {} } uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
62362025-03-25T22:05:13.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38741 req_id = 624689e6-c069-49d6-8211-2081de9173ba resource = Database result = Ok(()) uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
62372025-03-25T22:05:13.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2318 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38741 req_id = 624689e6-c069-49d6-8211-2081de9173ba response_code = 200 uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
62382025-03-25T22:05:13.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c6dc6323-ffdc-4a07-ae07-438f025468d3 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
62392025-03-25T22:05:13.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c6dc6323-ffdc-4a07-ae07-438f025468d3 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
62402025-03-25T22:05:13.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2479 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c6dc6323-ffdc-4a07-ae07-438f025468d3 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
62412025-03-25T22:05:14.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b5249d5c-b52e-45ef-b945-614182c725a8 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
62422025-03-25T22:05:14.789ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b5249d5c-b52e-45ef-b945-614182c725a8 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
62432025-03-25T22:05:14.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2349 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b5249d5c-b52e-45ef-b945-614182c725a8 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
62442025-03-25T22:05:15.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 68449740-4371-46f2-8473-e7fb5b099177 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
62452025-03-25T22:05:15.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 68449740-4371-46f2-8473-e7fb5b099177 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
62462025-03-25T22:05:15.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2928 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 68449740-4371-46f2-8473-e7fb5b099177 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
62472025-03-25T22:05:16.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6101fffd-9ff9-4dc7-adec-2ee266ded326 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
62482025-03-25T22:05:16.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6101fffd-9ff9-4dc7-adec-2ee266ded326 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
62492025-03-25T22:05:16.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1822 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6101fffd-9ff9-4dc7-adec-2ee266ded326 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
62502025-03-25T22:05:17.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6fff0657-6c3d-4b3a-b77e-757127da8dda roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
62512025-03-25T22:05:17.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6fff0657-6c3d-4b3a-b77e-757127da8dda resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
62522025-03-25T22:05:17.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2481 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6fff0657-6c3d-4b3a-b77e-757127da8dda response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
62532025-03-25T22:05:18.573ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 617 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = 22581a9e-9dfd-459a-a6ff-16a987ab9800 response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
62542025-03-25T22:05:18.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 80f654d1-61b7-4910-b443-20d6eee68dd8 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
62552025-03-25T22:05:18.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 80f654d1-61b7-4910-b443-20d6eee68dd8 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
62562025-03-25T22:05:18.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1735 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 80f654d1-61b7-4910-b443-20d6eee68dd8 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
62572025-03-25T22:05:19.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 28314472-56c3-403f-9e8e-3000286b553f roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
62582025-03-25T22:05:19.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 28314472-56c3-403f-9e8e-3000286b553f resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
62592025-03-25T22:05:19.900ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1984 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 28314472-56c3-403f-9e8e-3000286b553f response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
62602025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
62612025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
62622025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
62632025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62642025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
62652025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
62662025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
62672025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
62682025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
62692025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
62702025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62712025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
62722025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
62732025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62742025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
62752025-03-25T22:05:20.843ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-03-25 21:55:20.843174884 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
62762025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
62772025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
62782025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62792025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
62802025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
62812025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
62822025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
62832025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62842025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
62852025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
62862025-03-25T22:05:20.843ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:82 reason = blueprint disabled target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7
62872025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.81\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7"}
62882025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
62892025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
62902025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62912025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 4 reason = Timeout
62922025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
62932025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
62942025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
62952025-03-25T22:05:20.843ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
62962025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
62972025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
62982025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 11 reason = Timeout
62992025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
63002025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
63012025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63022025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
63032025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63042025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
63052025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
63062025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
63072025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63082025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63092025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
63102025-03-25T22:05:20.843ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
63112025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63122025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63132025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
63142025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
63152025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
63162025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
63172025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 11 reason = Timeout
63182025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
63192025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
63202025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63212025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
63222025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
63232025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
63242025-03-25T22:05:20.843ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
63252025-03-25T22:05:20.843ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
63262025-03-25T22:05:20.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
63272025-03-25T22:05:20.844ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63282025-03-25T22:05:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
63292025-03-25T22:05:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63302025-03-25T22:05:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
63312025-03-25T22:05:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
63322025-03-25T22:05:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63332025-03-25T22:05:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
63342025-03-25T22:05:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
63352025-03-25T22:05:20.844ZDEBGnexus (BackgroundTasks): activating background_task = tuf_artifact_replication iteration = 2 reason = Timeout
63362025-03-25T22:05:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
63372025-03-25T22:05:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
63382025-03-25T22:05:20.844ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
63392025-03-25T22:05:20.844ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
63402025-03-25T22:05:20.844ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
63412025-03-25T22:05:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
63422025-03-25T22:05:20.844ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
63432025-03-25T22:05:20.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
63442025-03-25T22:05:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
63452025-03-25T22:05:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63462025-03-25T22:05:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
63472025-03-25T22:05:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63482025-03-25T22:05:20.844ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("58d382a7-99da-40a7-bc9f-2da7e9b156c1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d42076c6-06fe-4102-a978-c7d0a8dffb98.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d42076c6-06fe-4102-a978-c7d0a8dffb98.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 6474, tv_nsec: 180316848 } })
63492025-03-25T22:05:20.844ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5533f428-2028-4269-b7b1-f15912c01133.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("66b022b6-2e12-413e-b4b7-56c4ad5bdd77.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f337d25b-c67a-4a32-89e1-e187aea97ed9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f337d25b-c67a-4a32-89e1-e187aea97ed9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 6474, tv_nsec: 180328149 } })
63502025-03-25T22:05:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63512025-03-25T22:05:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
63522025-03-25T22:05:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
63532025-03-25T22:05:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63542025-03-25T22:05:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63552025-03-25T22:05:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
63562025-03-25T22:05:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
63572025-03-25T22:05:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
63582025-03-25T22:05:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
63592025-03-25T22:05:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
63602025-03-25T22:05:20.844ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
63612025-03-25T22:05:20.844ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.005218ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
63622025-03-25T22:05:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
63632025-03-25T22:05:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
63642025-03-25T22:05:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
63652025-03-25T22:05:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
63662025-03-25T22:05:20.844ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
63672025-03-25T22:05:20.844ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.346083ms iteration = 6 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
63682025-03-25T22:05:20.844ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63692025-03-25T22:05:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63702025-03-25T22:05:20.846ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-03-25 21:55:20.843174884 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
63712025-03-25T22:05:20.846ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.045733ms iteration = 6 status = {"expiration":"2025-03-25T21:55:20.843174884Z","pruned":[]}
63722025-03-25T22:05:20.846ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.166716ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
63732025-03-25T22:05:20.846ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6474, tv_nsec: 183140058 } })
63742025-03-25T22:05:20.847ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1171
63752025-03-25T22:05:20.847ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6474, tv_nsec: 183801019 } })
63762025-03-25T22:05:20.847ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1171
63772025-03-25T22:05:20.848ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63782025-03-25T22:05:20.848ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63792025-03-25T22:05:20.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63802025-03-25T22:05:20.848ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63812025-03-25T22:05:20.849ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63822025-03-25T22:05:20.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
63832025-03-25T22:05:20.850ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63842025-03-25T22:05:20.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63852025-03-25T22:05:20.851ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
63862025-03-25T22:05:20.851ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63872025-03-25T22:05:20.851ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
63882025-03-25T22:05:20.851ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63892025-03-25T22:05:20.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63902025-03-25T22:05:20.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63912025-03-25T22:05:20.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63922025-03-25T22:05:20.852ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63932025-03-25T22:05:20.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63942025-03-25T22:05:20.853ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63952025-03-25T22:05:20.854ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63962025-03-25T22:05:20.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
63972025-03-25T22:05:20.854ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
63982025-03-25T22:05:20.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
63992025-03-25T22:05:20.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
64002025-03-25T22:05:20.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
64012025-03-25T22:05:20.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
64022025-03-25T22:05:20.856ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64032025-03-25T22:05:20.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
64042025-03-25T22:05:20.856ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
64052025-03-25T22:05:20.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64062025-03-25T22:05:20.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64072025-03-25T22:05:20.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
64082025-03-25T22:05:20.856ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
64092025-03-25T22:05:20.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
64102025-03-25T22:05:20.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64112025-03-25T22:05:20.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
64122025-03-25T22:05:20.859ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
64132025-03-25T22:05:20.859ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64142025-03-25T22:05:20.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64152025-03-25T22:05:20.859ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
64162025-03-25T22:05:20.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
64172025-03-25T22:05:20.859ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64182025-03-25T22:05:20.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64192025-03-25T22:05:20.860ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
64202025-03-25T22:05:20.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
64212025-03-25T22:05:20.861ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 17.76577ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
64222025-03-25T22:05:20.863ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
64232025-03-25T22:05:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
64242025-03-25T22:05:20.863ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
64252025-03-25T22:05:20.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
64262025-03-25T22:05:20.865ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64272025-03-25T22:05:20.868ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
64282025-03-25T22:05:20.868ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64292025-03-25T22:05:20.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
64302025-03-25T22:05:20.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64312025-03-25T22:05:20.868ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
64322025-03-25T22:05:20.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
64332025-03-25T22:05:20.869ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6474, tv_nsec: 205325795 } })
64342025-03-25T22:05:20.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
64352025-03-25T22:05:20.869ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1171 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
64362025-03-25T22:05:20.871ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64372025-03-25T22:05:20.871ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
64382025-03-25T22:05:20.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
64392025-03-25T22:05:20.875ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
64402025-03-25T22:05:20.875ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64412025-03-25T22:05:20.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64422025-03-25T22:05:20.881ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
64432025-03-25T22:05:20.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
64442025-03-25T22:05:20.883ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 39.565972ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
64452025-03-25T22:05:20.884ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64462025-03-25T22:05:20.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64472025-03-25T22:05:20.890ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
64482025-03-25T22:05:20.890ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
64492025-03-25T22:05:20.890ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
64502025-03-25T22:05:20.890ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
64512025-03-25T22:05:20.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
64522025-03-25T22:05:20.895ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64532025-03-25T22:05:20.899ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
64542025-03-25T22:05:20.899ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
64552025-03-25T22:05:20.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
64562025-03-25T22:05:20.906ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
64572025-03-25T22:05:20.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
64582025-03-25T22:05:20.919ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
64592025-03-25T22:05:20.919ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
64602025-03-25T22:05:20.919ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 75.57261ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
64612025-03-25T22:05:20.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 02790c41-9114-4f93-8e44-9159b86e83c3 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
64622025-03-25T22:05:20.921ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 02790c41-9114-4f93-8e44-9159b86e83c3 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
64632025-03-25T22:05:20.922ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64642025-03-25T22:05:20.925ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
64652025-03-25T22:05:20.925ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
64662025-03-25T22:05:20.925ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
64672025-03-25T22:05:20.925ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
64682025-03-25T22:05:20.925ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
64692025-03-25T22:05:20.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
64702025-03-25T22:05:20.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
64712025-03-25T22:05:20.928ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 84.909383ms iteration = 11 status = {"errors":[],"requests_created_ok":[]}
64722025-03-25T22:05:20.935ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64732025-03-25T22:05:20.937ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64742025-03-25T22:05:20.940ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
64752025-03-25T22:05:20.940ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
64762025-03-25T22:05:20.940ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64772025-03-25T22:05:20.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
64782025-03-25T22:05:20.941ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 97.158397ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
64792025-03-25T22:05:20.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64802025-03-25T22:05:20.941ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
64812025-03-25T22:05:20.941ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
64822025-03-25T22:05:20.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
64832025-03-25T22:05:20.941ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 97.742427ms iteration = 11 status = {"errors":[],"finish_invoked_ok":[]}
64842025-03-25T22:05:20.943ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64852025-03-25T22:05:20.943ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64862025-03-25T22:05:20.944ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
64872025-03-25T22:05:20.944ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
64882025-03-25T22:05:20.944ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 101.511933ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
64892025-03-25T22:05:20.946ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
64902025-03-25T22:05:20.946ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
64912025-03-25T22:05:20.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
64922025-03-25T22:05:20.947ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
64932025-03-25T22:05:20.947ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
64942025-03-25T22:05:20.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
64952025-03-25T22:05:20.949ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 106.715534ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
64962025-03-25T22:05:20.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 29278 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 02790c41-9114-4f93-8e44-9159b86e83c3 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
64972025-03-25T22:05:20.953ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
64982025-03-25T22:05:20.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
64992025-03-25T22:05:20.954ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65002025-03-25T22:05:20.954ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65012025-03-25T22:05:20.954ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
65022025-03-25T22:05:20.954ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
65032025-03-25T22:05:20.954ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
65042025-03-25T22:05:20.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
65052025-03-25T22:05:20.957ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
65062025-03-25T22:05:20.957ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
65072025-03-25T22:05:20.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
65082025-03-25T22:05:20.959ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
65092025-03-25T22:05:20.959ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
65102025-03-25T22:05:20.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
65112025-03-25T22:05:20.961ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
65122025-03-25T22:05:20.961ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 118.140354ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
65132025-03-25T22:05:20.962ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65142025-03-25T22:05:20.964ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
65152025-03-25T22:05:20.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
65162025-03-25T22:05:20.966ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
65172025-03-25T22:05:20.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
65182025-03-25T22:05:20.966ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
65192025-03-25T22:05:20.967ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 123.150221ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
65202025-03-25T22:05:20.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
65212025-03-25T22:05:20.967ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
65222025-03-25T22:05:20.967ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
65232025-03-25T22:05:20.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
65242025-03-25T22:05:20.967ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65252025-03-25T22:05:20.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65262025-03-25T22:05:20.974ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65272025-03-25T22:05:20.974ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65282025-03-25T22:05:20.977ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
65292025-03-25T22:05:20.977ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
65302025-03-25T22:05:20.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
65312025-03-25T22:05:20.978ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
65322025-03-25T22:05:20.978ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
65332025-03-25T22:05:20.978ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
65342025-03-25T22:05:20.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
65352025-03-25T22:05:20.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
65362025-03-25T22:05:20.981ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65372025-03-25T22:05:20.981ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65382025-03-25T22:05:20.981ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
65392025-03-25T22:05:20.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
65402025-03-25T22:05:20.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65412025-03-25T22:05:20.983ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
65422025-03-25T22:05:20.984ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
65432025-03-25T22:05:20.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
65442025-03-25T22:05:20.993ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65452025-03-25T22:05:20.993ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65462025-03-25T22:05:20.997ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
65472025-03-25T22:05:20.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
65482025-03-25T22:05:20.997ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
65492025-03-25T22:05:20.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
65502025-03-25T22:05:20.998ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f034aaf6-2037-4cb4-8409-3ab31c15cc28, lookup_type: ById(f034aaf6-2037-4cb4-8409-3ab31c15cc28) } result = Ok(())
65512025-03-25T22:05:20.998ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65522025-03-25T22:05:20.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65532025-03-25T22:05:20.999ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
65542025-03-25T22:05:21.000ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
65552025-03-25T22:05:21.000ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65562025-03-25T22:05:21.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
65572025-03-25T22:05:21.003ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
65582025-03-25T22:05:21.003ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
65592025-03-25T22:05:21.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
65602025-03-25T22:05:21.006ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65612025-03-25T22:05:21.009ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
65622025-03-25T22:05:21.009ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
65632025-03-25T22:05:21.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
65642025-03-25T22:05:21.012ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
65652025-03-25T22:05:21.012ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 96679ce4-e18c-487b-803a-7b26be55e85c dns_zone_name = oxide.test found_so_far = 0 version = 2
65662025-03-25T22:05:21.012ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
65672025-03-25T22:05:21.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
65682025-03-25T22:05:21.013ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
65692025-03-25T22:05:21.013ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
65702025-03-25T22:05:21.013ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
65712025-03-25T22:05:21.013ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
65722025-03-25T22:05:21.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
65732025-03-25T22:05:21.014ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 171.005277ms iteration = 13 status = {"physical_disks_added":0}
65742025-03-25T22:05:21.014ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 171.472166ms iteration = 11 status = 0
65752025-03-25T22:05:21.014ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65762025-03-25T22:05:21.016ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65772025-03-25T22:05:21.016ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
65782025-03-25T22:05:21.016ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
65792025-03-25T22:05:21.016ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
65802025-03-25T22:05:21.016ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "96679eef-ad9e-4b4f-a0c3-2de350841e10", "content-length": "26", "date": "Tue, 25 Mar 2025 22:05:21 GMT"} })
65812025-03-25T22:05:21.016ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
65822025-03-25T22:05:21.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
65832025-03-25T22:05:21.018ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
65842025-03-25T22:05:21.018ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 174.183513ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
65852025-03-25T22:05:21.018ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
65862025-03-25T22:05:21.019ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
65872025-03-25T22:05:21.019ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
65882025-03-25T22:05:21.019ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 175.284832ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
65892025-03-25T22:05:21.020ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
65902025-03-25T22:05:21.020ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
65912025-03-25T22:05:21.020ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
65922025-03-25T22:05:21.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
65932025-03-25T22:05:21.020ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
65942025-03-25T22:05:21.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
65952025-03-25T22:05:21.023ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 96679ce4-e18c-487b-803a-7b26be55e85c dns_zone_name = oxide.test found_so_far = 1 version = 2
65962025-03-25T22:05:21.023ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
65972025-03-25T22:05:21.023ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-03-25 22:00:22.561696 UTC dns_group = external generation = 2
65982025-03-25T22:05:21.023ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 180.575194ms iteration = 6 status = {"generation":2}
65992025-03-25T22:05:21.024ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 180.815649ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
66002025-03-25T22:05:21.029ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
66012025-03-25T22:05:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
66022025-03-25T22:05:21.031ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
66032025-03-25T22:05:21.032ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
66042025-03-25T22:05:21.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
66052025-03-25T22:05:21.038ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
66062025-03-25T22:05:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
66072025-03-25T22:05:21.043ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66082025-03-25T22:05:21.046ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
66092025-03-25T22:05:21.046ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
66102025-03-25T22:05:21.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
66112025-03-25T22:05:21.046ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
66122025-03-25T22:05:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
66132025-03-25T22:05:21.050ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
66142025-03-25T22:05:21.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
66152025-03-25T22:05:21.052ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
66162025-03-25T22:05:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
66172025-03-25T22:05:21.052ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
66182025-03-25T22:05:21.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
66192025-03-25T22:05:21.053ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66202025-03-25T22:05:21.056ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
66212025-03-25T22:05:21.056ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
66222025-03-25T22:05:21.056ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66232025-03-25T22:05:21.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
66242025-03-25T22:05:21.068ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
66252025-03-25T22:05:21.068ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
66262025-03-25T22:05:21.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
66272025-03-25T22:05:21.070ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:360
66282025-03-25T22:05:21.070ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 227.534685ms iteration = 11 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
66292025-03-25T22:05:21.072ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
66302025-03-25T22:05:21.072ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
66312025-03-25T22:05:21.072ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
66322025-03-25T22:05:21.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
66332025-03-25T22:05:21.073ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "95afbe42-faf4-4e54-b987-4fb09f5de059", "content-length": "26", "date": "Tue, 25 Mar 2025 22:05:21 GMT"} })
66342025-03-25T22:05:21.073ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
66352025-03-25T22:05:21.077ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
66362025-03-25T22:05:21.080ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
66372025-03-25T22:05:21.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
66382025-03-25T22:05:21.081ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
66392025-03-25T22:05:21.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
66402025-03-25T22:05:21.083ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66412025-03-25T22:05:21.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66422025-03-25T22:05:21.087ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-03-25T22:00:16.382271Z, time_modified: 2025-03-25T22:00:16.382271Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, db_silo: Silo { identity: SiloIdentity { id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-25T22:00:22.501108Z, time_modified: 2025-03-25T22:00:22.501108Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, db_silo: Silo { identity: SiloIdentity { id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-25T22:00:22.501108Z, time_modified: 2025-03-25T22:00:22.501108Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d" }] }) }
66432025-03-25T22:05:21.087ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 244.43304ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"5c35ff8c-21dd-48b9-9751-76bfa681bc38","tls_certs":["0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d"]}},"default_endpoint":{"silo_id":"5c35ff8c-21dd-48b9-9751-76bfa681bc38","tls_certs":["0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
66442025-03-25T22:05:21.104ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
66452025-03-25T22:05:21.104ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 23d93905-7b89-4296-b050-7ff9ae235c15 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
66462025-03-25T22:05:21.104ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
66472025-03-25T22:05:21.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
66482025-03-25T22:05:21.111ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
66492025-03-25T22:05:21.115ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
66502025-03-25T22:05:21.115ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 271.412611ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
66512025-03-25T22:05:21.182ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 zone_address = fd00:1122:3344:101::2
66522025-03-25T22:05:21.183ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
66532025-03-25T22:05:21.183ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "47a9a320-e62b-4af6-839c-c384146bba26", "content-length": "26", "date": "Tue, 25 Mar 2025 22:05:21 GMT"} })
66542025-03-25T22:05:21.183ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1184 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
66552025-03-25T22:05:21.186ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
66562025-03-25T22:05:21.266ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
66572025-03-25T22:05:21.267ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "37470123-d747-446a-9567-923ebbc3fafd", "content-length": "1", "date": "Tue, 25 Mar 2025 22:05:20 GMT"} })
66582025-03-25T22:05:21.268ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
66592025-03-25T22:05:21.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
66602025-03-25T22:05:21.280ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 437.868789ms iteration = 11 status = {}
66612025-03-25T22:05:21.293ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
66622025-03-25T22:05:21.293ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
66632025-03-25T22:05:21.293ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "313d8c96-3765-40d9-93c0-31d8e26d5009", "content-length": "372", "date": "Tue, 25 Mar 2025 22:05:21 GMT"} })
66642025-03-25T22:05:21.293ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66652025-03-25T22:05:21.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66662025-03-25T22:05:21.296ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66672025-03-25T22:05:21.296ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
66682025-03-25T22:05:21.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
66692025-03-25T22:05:21.298ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
66702025-03-25T22:05:21.298ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
66712025-03-25T22:05:21.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
66722025-03-25T22:05:21.299ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66732025-03-25T22:05:21.302ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 458.766214ms iteration = 11 status = null
66742025-03-25T22:05:21.302ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
66752025-03-25T22:05:21.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
66762025-03-25T22:05:21.303ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
66772025-03-25T22:05:21.303ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
66782025-03-25T22:05:21.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
66792025-03-25T22:05:21.303ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
66802025-03-25T22:05:21.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
66812025-03-25T22:05:21.304ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
66822025-03-25T22:05:21.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
66832025-03-25T22:05:21.305ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66842025-03-25T22:05:21.306ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
66852025-03-25T22:05:21.306ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
66862025-03-25T22:05:21.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
66872025-03-25T22:05:21.306ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 23d93905-7b89-4296-b050-7ff9ae235c15 dns_zone_name = control-plane.oxide.internal found_so_far = 52 version = 1
66882025-03-25T22:05:21.306ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
66892025-03-25T22:05:21.306ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-03-25 22:00:21.368103 UTC dns_group = internal generation = 1
66902025-03-25T22:05:21.306ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 463.405605ms iteration = 6 status = {"generation":1}
66912025-03-25T22:05:21.306ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "86576a2c-617b-4911-a0e5-22eb156a6c18", "date": "Tue, 25 Mar 2025 22:05:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
66922025-03-25T22:05:21.306ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
66932025-03-25T22:05:21.308ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66942025-03-25T22:05:21.308ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
66952025-03-25T22:05:21.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
66962025-03-25T22:05:21.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
66972025-03-25T22:05:21.309ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "b3a4579a-00fb-448f-88d5-cad81bfe6741", "date": "Tue, 25 Mar 2025 22:05:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
66982025-03-25T22:05:21.309ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
66992025-03-25T22:05:21.309ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
67002025-03-25T22:05:21.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
67012025-03-25T22:05:21.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
67022025-03-25T22:05:21.311ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
67032025-03-25T22:05:21.312ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 468.881921ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
67042025-03-25T22:05:21.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67052025-03-25T22:05:21.312ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
67062025-03-25T22:05:21.312ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67072025-03-25T22:05:21.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67082025-03-25T22:05:21.314ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67092025-03-25T22:05:21.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67102025-03-25T22:05:21.314ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
67112025-03-25T22:05:21.314ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
67122025-03-25T22:05:21.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
67132025-03-25T22:05:21.314ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
67142025-03-25T22:05:21.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
67152025-03-25T22:05:21.315ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67162025-03-25T22:05:21.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67172025-03-25T22:05:21.317ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
67182025-03-25T22:05:21.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
67192025-03-25T22:05:21.320ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67202025-03-25T22:05:21.321ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67212025-03-25T22:05:21.323ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
67222025-03-25T22:05:21.323ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
67232025-03-25T22:05:21.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
67242025-03-25T22:05:21.325ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
67252025-03-25T22:05:21.325ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67262025-03-25T22:05:21.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67272025-03-25T22:05:21.328ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
67282025-03-25T22:05:21.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
67292025-03-25T22:05:21.330ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67302025-03-25T22:05:21.334ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
67312025-03-25T22:05:21.334ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
67322025-03-25T22:05:21.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
67332025-03-25T22:05:21.339ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
67342025-03-25T22:05:21.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
67352025-03-25T22:05:21.340ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67362025-03-25T22:05:21.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67372025-03-25T22:05:21.341ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67382025-03-25T22:05:21.342ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67392025-03-25T22:05:21.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67402025-03-25T22:05:21.343ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
67412025-03-25T22:05:21.343ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
67422025-03-25T22:05:21.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
67432025-03-25T22:05:21.345ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67442025-03-25T22:05:21.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67452025-03-25T22:05:21.347ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
67462025-03-25T22:05:21.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
67472025-03-25T22:05:21.348ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67482025-03-25T22:05:21.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67492025-03-25T22:05:21.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67502025-03-25T22:05:21.350ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67512025-03-25T22:05:21.350ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
67522025-03-25T22:05:21.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
67532025-03-25T22:05:21.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
67542025-03-25T22:05:21.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67552025-03-25T22:05:21.352ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67562025-03-25T22:05:21.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67572025-03-25T22:05:21.354ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67582025-03-25T22:05:21.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67592025-03-25T22:05:21.355ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67602025-03-25T22:05:21.359ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
67612025-03-25T22:05:21.359ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67622025-03-25T22:05:21.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67632025-03-25T22:05:21.364ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67642025-03-25T22:05:21.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67652025-03-25T22:05:21.367ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67662025-03-25T22:05:21.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67672025-03-25T22:05:21.372ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67682025-03-25T22:05:21.373ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
67692025-03-25T22:05:21.374ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "16e2beb0-4c51-405e-99e7-697bfb43b2cf", "date": "Tue, 25 Mar 2025 22:05:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
67702025-03-25T22:05:21.374ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
67712025-03-25T22:05:21.374ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
67722025-03-25T22:05:21.374ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
67732025-03-25T22:05:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
67742025-03-25T22:05:21.375ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
67752025-03-25T22:05:21.375ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e9fe105b-99c0-4eba-ba0d-907cd0df126d", "date": "Tue, 25 Mar 2025 22:05:21 GMT"} })
67762025-03-25T22:05:21.375ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67772025-03-25T22:05:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
67782025-03-25T22:05:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67792025-03-25T22:05:21.375ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "0742da08-95a7-43a9-b8ea-da2d5adfe0a6", "date": "Tue, 25 Mar 2025 22:05:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
67802025-03-25T22:05:21.375ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
67812025-03-25T22:05:21.377ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67822025-03-25T22:05:21.378ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "7bbd63da-208d-4738-8de8-9bfbfc70c215", "date": "Tue, 25 Mar 2025 22:05:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
67832025-03-25T22:05:21.378ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
67842025-03-25T22:05:21.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67852025-03-25T22:05:21.380ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
67862025-03-25T22:05:21.380ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 537.858416ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
67872025-03-25T22:05:21.382ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67882025-03-25T22:05:21.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67892025-03-25T22:05:21.384ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
67902025-03-25T22:05:21.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
67912025-03-25T22:05:21.386ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
67922025-03-25T22:05:21.386ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
67932025-03-25T22:05:21.386ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9394c53e-bb36-48c8-8ba3-746b22b3a641", "date": "Tue, 25 Mar 2025 22:05:21 GMT"} })
67942025-03-25T22:05:21.388ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 544.96531ms iteration = 11 status = {}
67952025-03-25T22:05:21.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67962025-03-25T22:05:21.396ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
67972025-03-25T22:05:21.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
67982025-03-25T22:05:21.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
67992025-03-25T22:05:21.399ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:113 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
68002025-03-25T22:05:21.399ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 556.517301ms iteration = 4 status = {"blueprint_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","inventory_collection_id":"fc6c9148-0a29-46f4-a0bf-8838f37c405a","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":4,"num_already_tombstoned":0,"num_inserted":5,"num_not_in_inventory":0,"num_tombstoned":0}}}
68012025-03-25T22:05:21.404ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68022025-03-25T22:05:21.407ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
68032025-03-25T22:05:21.407ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68042025-03-25T22:05:21.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68052025-03-25T22:05:21.414ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68062025-03-25T22:05:21.415ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 29ce53a2-9f51-4baa-936c-a430afb38f28, kind: Service { id: d42076c6-06fe-4102-a978-c7d0a8dffb98 }, name: Name("external-dns-d42076c6-06fe-4102-a978-c7d0a8dffb98"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 55e2e815-bc90-43ee-bb61-e37b76792d5f, kind: Service { id: 58d382a7-99da-40a7-bc9f-2da7e9b156c1 }, name: Name("external-dns-58d382a7-99da-40a7-bc9f-2da7e9b156c1"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 30])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 12a41e9e-9631-4d38-b839-8dd2f1307510, kind: Service { id: f578ebd7-76c9-43f2-8d8c-99a164224c1c }, name: Name("nexus-f578ebd7-76c9-43f2-8d8c-99a164224c1c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 27c97441-bb9e-4408-b832-44b304dbd319, kind: Service { id: dc04dd71-e9ce-4d94-8637-d87f47eb7409 }, name: Name("nexus-dc04dd71-e9ce-4d94-8637-d87f47eb7409"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 244])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: de8b1653-42da-41b0-b524-fe87fd1390a1, kind: Service { id: 76a4636e-6952-47a1-8a71-cd6816e00858 }, name: Name("nexus-76a4636e-6952-47a1-8a71-cd6816e00858"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 87])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
68072025-03-25T22:05:21.415ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68082025-03-25T22:05:21.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68092025-03-25T22:05:21.416ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
68102025-03-25T22:05:21.416ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
68112025-03-25T22:05:21.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
68122025-03-25T22:05:21.417ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68132025-03-25T22:05:21.419ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
68142025-03-25T22:05:21.419ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68152025-03-25T22:05:21.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68162025-03-25T22:05:21.420ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68172025-03-25T22:05:21.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68182025-03-25T22:05:21.421ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
68192025-03-25T22:05:21.421ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 29ce53a2-9f51-4baa-936c-a430afb38f28, kind: Service { id: d42076c6-06fe-4102-a978-c7d0a8dffb98 }, name: Name("external-dns-d42076c6-06fe-4102-a978-c7d0a8dffb98"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 55e2e815-bc90-43ee-bb61-e37b76792d5f, kind: Service { id: 58d382a7-99da-40a7-bc9f-2da7e9b156c1 }, name: Name("external-dns-58d382a7-99da-40a7-bc9f-2da7e9b156c1"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 30])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 12a41e9e-9631-4d38-b839-8dd2f1307510, kind: Service { id: f578ebd7-76c9-43f2-8d8c-99a164224c1c }, name: Name("nexus-f578ebd7-76c9-43f2-8d8c-99a164224c1c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 27c97441-bb9e-4408-b832-44b304dbd319, kind: Service { id: dc04dd71-e9ce-4d94-8637-d87f47eb7409 }, name: Name("nexus-dc04dd71-e9ce-4d94-8637-d87f47eb7409"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 244])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: de8b1653-42da-41b0-b524-fe87fd1390a1, kind: Service { id: 76a4636e-6952-47a1-8a71-cd6816e00858 }, name: Name("nexus-76a4636e-6952-47a1-8a71-cd6816e00858"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 87])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
68202025-03-25T22:05:21.421ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
68212025-03-25T22:05:21.421ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68222025-03-25T22:05:21.423ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
68232025-03-25T22:05:21.423ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68242025-03-25T22:05:21.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68252025-03-25T22:05:21.425ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68262025-03-25T22:05:21.425ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = tuf_artifact_replication body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/artifacts-config
68272025-03-25T22:05:21.426ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts-config", status: 204, headers: {"x-request-id": "1d3ead59-9fb8-428b-a50a-788518d4cd51", "date": "Tue, 25 Mar 2025 22:05:21 GMT"} })
68282025-03-25T22:05:21.426ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = tuf_artifact_replication body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/artifacts
68292025-03-25T22:05:21.427ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8dd6f53-2f9c-47dd-9f63-0492d691d8d0", "content-length": "26", "date": "Tue, 25 Mar 2025 22:05:21 GMT"} })
68302025-03-25T22:05:21.427ZINFOnexus (BackgroundTasks): Successfully got artifact list background_task = tuf_artifact_replication file = nexus/src/app/background/tasks/tuf_artifact_replication.rs:673 sled = http://[fd00:1122:3344:101::1]:12345
68312025-03-25T22:05:21.427ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
68322025-03-25T22:05:21.427ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68332025-03-25T22:05:21.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68342025-03-25T22:05:21.428ZDEBGnexus (BackgroundTasks): activation complete background_task = tuf_artifact_replication elapsed = 584.903957ms iteration = 2 status = {"generation":1,"last_run_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":1,"put_config_err":0,"put_config_ok":1,"put_err":0,"put_ok":0},"lifetime_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":2,"put_config_err":0,"put_config_ok":2,"put_err":0,"put_ok":0},"local_repos":0,"request_debug_ringbuf":[{"generation":1,"operation":"put_config","target_sled":"f034aaf6-2037-4cb4-8409-3ab31c15cc28","time":"2025-03-25T22:00:21.321183573Z"},{"operation":"list","target_sled":"f034aaf6-2037-4cb4-8409-3ab31c15cc28","time":"2025-03-25T22:00:21.323912581Z"},{"generation":1,"operation":"put_config","target_sled":"f034aaf6-2037-4cb4-8409-3ab31c15cc28","time":"2025-03-25T22:05:21.426700637Z"},{"operation":"list","target_sled":"f034aaf6-2037-4cb4-8409-3ab31c15cc28","time":"2025-03-25T22:05:21.427093324Z"}]}
68352025-03-25T22:05:21.444ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68362025-03-25T22:05:21.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68372025-03-25T22:05:21.447ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a5db250-fa3f-4168-ab16-5c36568c22e2, rack_id: c7210e4b-5a81-4ec8-b8fe-816a9508dc74, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(6d5dda50-e3c4-4853-9bfa-a66b447ab351) } rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
68382025-03-25T22:05:21.447ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68392025-03-25T22:05:21.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68402025-03-25T22:05:21.457ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
68412025-03-25T22:05:21.458ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d0cdfab-926e-4af6-bc88-2cece118c071", "content-length": "134", "date": "Tue, 25 Mar 2025 22:05:21 GMT"} })
68422025-03-25T22:05:21.458ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
68432025-03-25T22:05:21.458ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 6d5dda50-e3c4-4853-9bfa-a66b447ab351
68442025-03-25T22:05:21.458ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
68452025-03-25T22:05:21.458ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
68462025-03-25T22:05:21.458ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68472025-03-25T22:05:21.458ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68482025-03-25T22:05:21.458ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68492025-03-25T22:05:21.458ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
68502025-03-25T22:05:21.458ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68512025-03-25T22:05:21.458ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
68522025-03-25T22:05:21.458ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
68532025-03-25T22:05:21.458ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68542025-03-25T22:05:21.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68552025-03-25T22:05:21.460ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
68562025-03-25T22:05:21.461ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "dfd3983e-36d8-4eab-94e5-228726b0d189", "content-length": "2", "date": "Tue, 25 Mar 2025 22:05:21 GMT"} })
68572025-03-25T22:05:21.461ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
68582025-03-25T22:05:21.461ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "1afc4d7c-a34d-49bb-b50d-915d3915f825", "content-length": "52", "date": "Tue, 25 Mar 2025 22:05:21 GMT"} })
68592025-03-25T22:05:21.461ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
68602025-03-25T22:05:21.461ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
68612025-03-25T22:05:21.470ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
68622025-03-25T22:05:21.554ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: f034aaf6-2037-4cb4-8409-3ab31c15cc28, time_created: 2025-03-25T22:00:19.994158Z, time_modified: 2025-03-25T22:00:19.994158Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: c7210e4b-5a81-4ec8-b8fe-816a9508dc74, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)), repo_depot_port: SqlU16(12348) }]
68632025-03-25T22:05:21.554ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
68642025-03-25T22:05:21.556ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68652025-03-25T22:05:21.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68662025-03-25T22:05:21.560ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68672025-03-25T22:05:21.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68682025-03-25T22:05:21.562ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68692025-03-25T22:05:21.564ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: f034aaf6-2037-4cb4-8409-3ab31c15cc28, lookup_type: ById(f034aaf6-2037-4cb4-8409-3ab31c15cc28) } result = Ok(())
68702025-03-25T22:05:21.584ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a9ffd923-49a3-4928-9cc1-7fe992a62fbe", "date": "Tue, 25 Mar 2025 22:05:21 GMT"} })
68712025-03-25T22:05:21.584ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch = Switch0
68722025-03-25T22:05:21.584ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
68732025-03-25T22:05:21.584ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a1b51d1-b4da-4167-8c98-ba3dfe82ed6b", "content-length": "682", "date": "Tue, 25 Mar 2025 22:05:21 GMT"} })
68742025-03-25T22:05:21.584ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68752025-03-25T22:05:21.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68762025-03-25T22:05:21.585ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8f505d3-27dd-4b82-b8d1-d1b935939ae1", "content-length": "691", "date": "Tue, 25 Mar 2025 22:05:21 GMT"} })
68772025-03-25T22:05:21.585ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
68782025-03-25T22:05:21.585ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
68792025-03-25T22:05:21.585ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
68802025-03-25T22:05:21.587ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 744.004726ms iteration = 11 status = {}
68812025-03-25T22:05:21.589ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68822025-03-25T22:05:21.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68832025-03-25T22:05:21.593ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68842025-03-25T22:05:21.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68852025-03-25T22:05:21.595ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68862025-03-25T22:05:21.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68872025-03-25T22:05:21.599ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
68882025-03-25T22:05:21.602ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 759.14092ms iteration = 11 status = {}
68892025-03-25T22:05:21.604ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "7f55dcf6-cab8-4f01-a337-d5fa6191168d", "date": "Tue, 25 Mar 2025 22:05:21 GMT"} })
68902025-03-25T22:05:21.606ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
68912025-03-25T22:05:21.606ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 762.670922ms
68922025-03-25T22:05:21.606ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 762.677062ms iteration = 2 status = {}
68932025-03-25T22:05:21.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 242ff3c0-2b77-498a-9e11-271c61cd4200 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
68942025-03-25T22:05:21.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 242ff3c0-2b77-498a-9e11-271c61cd4200 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
68952025-03-25T22:05:21.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2575 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 242ff3c0-2b77-498a-9e11-271c61cd4200 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
68962025-03-25T22:05:23.003ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c5ed7814-dfee-4a2e-81a5-20f7b1fa53cb roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
68972025-03-25T22:05:23.003ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c5ed7814-dfee-4a2e-81a5-20f7b1fa53cb resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
68982025-03-25T22:05:23.005ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2536 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c5ed7814-dfee-4a2e-81a5-20f7b1fa53cb response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
68992025-03-25T22:05:24.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3199ae75-7cc5-477c-9bb8-29635b8af4f7 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69002025-03-25T22:05:24.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3199ae75-7cc5-477c-9bb8-29635b8af4f7 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69012025-03-25T22:05:24.026ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2694 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3199ae75-7cc5-477c-9bb8-29635b8af4f7 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69022025-03-25T22:05:25.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d852ba87-ba4e-4e17-8d23-52a57b50db58 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69032025-03-25T22:05:25.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d852ba87-ba4e-4e17-8d23-52a57b50db58 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69042025-03-25T22:05:25.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2066 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d852ba87-ba4e-4e17-8d23-52a57b50db58 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69052025-03-25T22:05:26.067ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6ec96781-58d3-4e35-9a90-bd662e43a954 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69062025-03-25T22:05:26.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6ec96781-58d3-4e35-9a90-bd662e43a954 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69072025-03-25T22:05:26.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2441 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6ec96781-58d3-4e35-9a90-bd662e43a954 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69082025-03-25T22:05:27.089ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = bd0ccd55-33e9-451d-be7e-071d41c92fe9 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69092025-03-25T22:05:27.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = bd0ccd55-33e9-451d-be7e-071d41c92fe9 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69102025-03-25T22:05:27.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1787 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = bd0ccd55-33e9-451d-be7e-071d41c92fe9 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69112025-03-25T22:05:28.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ce65dc26-5fa3-4ead-8c52-df5c4264253a roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69122025-03-25T22:05:28.113ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ce65dc26-5fa3-4ead-8c52-df5c4264253a resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69132025-03-25T22:05:28.114ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1968 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ce65dc26-5fa3-4ead-8c52-df5c4264253a response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69142025-03-25T22:05:28.572ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 592 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = 2d7da7fc-faff-4f85-bade-aa7a51810b07 response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
69152025-03-25T22:05:29.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f87356b4-c509-4794-bdfd-04053dd604cd roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69162025-03-25T22:05:29.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f87356b4-c509-4794-bdfd-04053dd604cd resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69172025-03-25T22:05:29.135ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2120 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f87356b4-c509-4794-bdfd-04053dd604cd response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69182025-03-25T22:05:30.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4b2703e4-e8f3-4892-8318-f2fc49719e99 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69192025-03-25T22:05:30.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4b2703e4-e8f3-4892-8318-f2fc49719e99 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69202025-03-25T22:05:30.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1929 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4b2703e4-e8f3-4892-8318-f2fc49719e99 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69212025-03-25T22:05:30.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
69222025-03-25T22:05:30.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69232025-03-25T22:05:30.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69242025-03-25T22:05:30.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
69252025-03-25T22:05:30.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69262025-03-25T22:05:30.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69272025-03-25T22:05:30.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69282025-03-25T22:05:30.846ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69292025-03-25T22:05:30.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69302025-03-25T22:05:30.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
69312025-03-25T22:05:30.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69322025-03-25T22:05:30.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69332025-03-25T22:05:30.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69342025-03-25T22:05:30.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69352025-03-25T22:05:30.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69362025-03-25T22:05:30.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
69372025-03-25T22:05:30.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69382025-03-25T22:05:30.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69392025-03-25T22:05:30.864ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
69402025-03-25T22:05:30.864ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.866042ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
69412025-03-25T22:05:30.876ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.675971ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
69422025-03-25T22:05:31.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0e9450d3-4b6c-4963-b8d6-62d52fd938e0 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69432025-03-25T22:05:31.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0e9450d3-4b6c-4963-b8d6-62d52fd938e0 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69442025-03-25T22:05:31.178ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2027 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0e9450d3-4b6c-4963-b8d6-62d52fd938e0 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69452025-03-25T22:05:32.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a419ae7a-765c-4100-82b4-71fc269c0404 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69462025-03-25T22:05:32.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a419ae7a-765c-4100-82b4-71fc269c0404 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69472025-03-25T22:05:32.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2091 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a419ae7a-765c-4100-82b4-71fc269c0404 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69482025-03-25T22:05:33.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 835ba906-c6d3-43ac-a9a7-73e0551a998e roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69492025-03-25T22:05:33.220ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 835ba906-c6d3-43ac-a9a7-73e0551a998e resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69502025-03-25T22:05:33.222ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2309 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 835ba906-c6d3-43ac-a9a7-73e0551a998e response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69512025-03-25T22:05:34.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b2514d8b-e3ee-4087-ba9a-9817c5c9053e roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69522025-03-25T22:05:34.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b2514d8b-e3ee-4087-ba9a-9817c5c9053e resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69532025-03-25T22:05:34.244ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1993 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b2514d8b-e3ee-4087-ba9a-9817c5c9053e response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69542025-03-25T22:05:35.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8ec40b82-316d-44ba-b50e-1004c76bcf02 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69552025-03-25T22:05:35.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8ec40b82-316d-44ba-b50e-1004c76bcf02 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69562025-03-25T22:05:35.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2052 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8ec40b82-316d-44ba-b50e-1004c76bcf02 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69572025-03-25T22:05:36.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 26447e82-71b3-4c92-a948-2f5bcdb4408e roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69582025-03-25T22:05:36.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 26447e82-71b3-4c92-a948-2f5bcdb4408e resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69592025-03-25T22:05:36.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2060 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 26447e82-71b3-4c92-a948-2f5bcdb4408e response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69602025-03-25T22:05:37.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = cad56063-0155-4e05-b278-059a21baf6a8 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69612025-03-25T22:05:37.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = cad56063-0155-4e05-b278-059a21baf6a8 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69622025-03-25T22:05:37.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2429 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = cad56063-0155-4e05-b278-059a21baf6a8 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69632025-03-25T22:05:38.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8c86ef06-933e-447e-b665-f6cab3ddd596 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69642025-03-25T22:05:38.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8c86ef06-933e-447e-b665-f6cab3ddd596 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69652025-03-25T22:05:38.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2588 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8c86ef06-933e-447e-b665-f6cab3ddd596 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69662025-03-25T22:05:38.573ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 805 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = b7dd1929-b88a-4910-af47-4b33095ce544 response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
69672025-03-25T22:05:39.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 332d49d2-d913-4397-abe1-3187d49d57c1 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69682025-03-25T22:05:39.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 332d49d2-d913-4397-abe1-3187d49d57c1 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69692025-03-25T22:05:39.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1611 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 332d49d2-d913-4397-abe1-3187d49d57c1 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69702025-03-25T22:05:40.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b37dd2ac-b4ea-4a33-9d48-22909c61ba14 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69712025-03-25T22:05:40.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b37dd2ac-b4ea-4a33-9d48-22909c61ba14 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69722025-03-25T22:05:40.375ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2521 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b37dd2ac-b4ea-4a33-9d48-22909c61ba14 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69732025-03-25T22:05:40.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
69742025-03-25T22:05:40.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69752025-03-25T22:05:40.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69762025-03-25T22:05:40.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
69772025-03-25T22:05:40.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69782025-03-25T22:05:40.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69792025-03-25T22:05:40.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69802025-03-25T22:05:40.846ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69812025-03-25T22:05:40.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69822025-03-25T22:05:40.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
69832025-03-25T22:05:40.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69842025-03-25T22:05:40.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69852025-03-25T22:05:40.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69862025-03-25T22:05:40.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69872025-03-25T22:05:40.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69882025-03-25T22:05:40.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
69892025-03-25T22:05:40.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69902025-03-25T22:05:40.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69912025-03-25T22:05:40.862ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
69922025-03-25T22:05:40.862ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.89443ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
69932025-03-25T22:05:40.876ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.274384ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
69942025-03-25T22:05:41.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f4d72220-6cfb-4b75-bf77-9657f7be76bb roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69952025-03-25T22:05:41.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f4d72220-6cfb-4b75-bf77-9657f7be76bb resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69962025-03-25T22:05:41.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2368 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f4d72220-6cfb-4b75-bf77-9657f7be76bb response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69972025-03-25T22:05:42.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ad2c8b11-5dc3-451d-8d7e-6014e1a06d22 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69982025-03-25T22:05:42.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ad2c8b11-5dc3-451d-8d7e-6014e1a06d22 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
69992025-03-25T22:05:42.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2318 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ad2c8b11-5dc3-451d-8d7e-6014e1a06d22 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
70002025-03-25T22:05:43.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6173f2f5-895c-4b71-bbcc-2140fb44c016 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
70012025-03-25T22:05:43.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6173f2f5-895c-4b71-bbcc-2140fb44c016 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
70022025-03-25T22:05:43.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1647 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6173f2f5-895c-4b71-bbcc-2140fb44c016 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
70032025-03-25T22:05:43.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38741 req_id = 19ab9c25-9720-46f0-bf86-d69503550b71 roles = RoleSet { roles: {} } uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
70042025-03-25T22:05:43.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38741 req_id = 19ab9c25-9720-46f0-bf86-d69503550b71 resource = Database result = Ok(()) uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
70052025-03-25T22:05:43.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3016 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38741 req_id = 19ab9c25-9720-46f0-bf86-d69503550b71 response_code = 200 uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
70062025-03-25T22:05:43.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38741 req_id = ba08b352-244a-4148-9d6e-cd236ee2f8d8 roles = RoleSet { roles: {} } uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
70072025-03-25T22:05:43.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38741 req_id = ba08b352-244a-4148-9d6e-cd236ee2f8d8 resource = Database result = Ok(()) uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
70082025-03-25T22:05:43.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2082 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38741 req_id = ba08b352-244a-4148-9d6e-cd236ee2f8d8 response_code = 200 uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
70092025-03-25T22:05:44.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = bb67fb43-ad00-44aa-ab9c-bb681534a459 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
70102025-03-25T22:05:44.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = bb67fb43-ad00-44aa-ab9c-bb681534a459 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
70112025-03-25T22:05:44.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2119 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = bb67fb43-ad00-44aa-ab9c-bb681534a459 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
70122025-03-25T22:05:45.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 76da282c-125e-4300-9a93-2a3cad67dd42 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
70132025-03-25T22:05:45.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 76da282c-125e-4300-9a93-2a3cad67dd42 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
70142025-03-25T22:05:45.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2040 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 76da282c-125e-4300-9a93-2a3cad67dd42 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
70152025-03-25T22:05:46.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 848e6f82-1365-4ef9-8e67-02366ad47678 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
70162025-03-25T22:05:46.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 848e6f82-1365-4ef9-8e67-02366ad47678 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
70172025-03-25T22:05:46.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2274 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 848e6f82-1365-4ef9-8e67-02366ad47678 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
70182025-03-25T22:05:47.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = cac8fb23-98f6-47b5-a827-b69316c548ad roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
70192025-03-25T22:05:47.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = cac8fb23-98f6-47b5-a827-b69316c548ad resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
70202025-03-25T22:05:47.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2221 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = cac8fb23-98f6-47b5-a827-b69316c548ad response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
70212025-03-25T22:05:48.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 29aa6c72-49f9-436f-8f90-ee55e73a8e97 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
70222025-03-25T22:05:48.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 29aa6c72-49f9-436f-8f90-ee55e73a8e97 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
70232025-03-25T22:05:48.548ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2160 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 29aa6c72-49f9-436f-8f90-ee55e73a8e97 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
70242025-03-25T22:05:48.573ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 845 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = 69a1aa78-5476-4540-bb02-6a900c11b9a8 response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
70252025-03-25T22:05:49.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6685ac02-84c3-4493-9b7b-8ac40daffc64 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
70262025-03-25T22:05:49.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6685ac02-84c3-4493-9b7b-8ac40daffc64 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
70272025-03-25T22:05:49.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2760 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6685ac02-84c3-4493-9b7b-8ac40daffc64 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
70282025-03-25T22:05:50.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f007b77c-d6a8-4035-be79-c4a4a9e219f5 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
70292025-03-25T22:05:50.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f007b77c-d6a8-4035-be79-c4a4a9e219f5 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
70302025-03-25T22:05:50.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2755 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f007b77c-d6a8-4035-be79-c4a4a9e219f5 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
70312025-03-25T22:05:50.843ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
70322025-03-25T22:05:50.843ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
70332025-03-25T22:05:50.843ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
70342025-03-25T22:05:50.843ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
70352025-03-25T22:05:50.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
70362025-03-25T22:05:50.843ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 12 reason = Timeout
70372025-03-25T22:05:50.843ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70382025-03-25T22:05:50.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70392025-03-25T22:05:50.843ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
70402025-03-25T22:05:50.843ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
70412025-03-25T22:05:50.843ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
70422025-03-25T22:05:50.843ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70432025-03-25T22:05:50.843ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70442025-03-25T22:05:50.843ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
70452025-03-25T22:05:50.843ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70462025-03-25T22:05:50.843ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
70472025-03-25T22:05:50.843ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
70482025-03-25T22:05:50.843ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
70492025-03-25T22:05:50.843ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
70502025-03-25T22:05:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70512025-03-25T22:05:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
70522025-03-25T22:05:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
70532025-03-25T22:05:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70542025-03-25T22:05:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70552025-03-25T22:05:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70562025-03-25T22:05:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
70572025-03-25T22:05:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70582025-03-25T22:05:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
70592025-03-25T22:05:50.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
70602025-03-25T22:05:50.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
70612025-03-25T22:05:50.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70622025-03-25T22:05:50.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
70632025-03-25T22:05:50.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
70642025-03-25T22:05:50.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
70652025-03-25T22:05:50.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
70662025-03-25T22:05:50.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
70672025-03-25T22:05:50.844ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 12 reason = Timeout
70682025-03-25T22:05:50.844ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
70692025-03-25T22:05:50.844ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
70702025-03-25T22:05:50.844ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
70712025-03-25T22:05:50.845ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70722025-03-25T22:05:50.845ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
70732025-03-25T22:05:50.845ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
70742025-03-25T22:05:50.845ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
70752025-03-25T22:05:50.845ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
70762025-03-25T22:05:50.845ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
70772025-03-25T22:05:50.845ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
70782025-03-25T22:05:50.845ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
70792025-03-25T22:05:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70802025-03-25T22:05:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
70812025-03-25T22:05:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
70822025-03-25T22:05:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
70832025-03-25T22:05:50.845ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70842025-03-25T22:05:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
70852025-03-25T22:05:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
70862025-03-25T22:05:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
70872025-03-25T22:05:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70882025-03-25T22:05:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
70892025-03-25T22:05:50.846ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6504, tv_nsec: 182558457 } })
70902025-03-25T22:05:50.846ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70912025-03-25T22:05:50.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70922025-03-25T22:05:50.846ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1171
70932025-03-25T22:05:50.847ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.927929ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
70942025-03-25T22:05:50.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
70952025-03-25T22:05:50.848ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70962025-03-25T22:05:50.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70972025-03-25T22:05:50.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
70982025-03-25T22:05:50.848ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
70992025-03-25T22:05:50.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
71002025-03-25T22:05:50.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
71012025-03-25T22:05:50.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71022025-03-25T22:05:50.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71032025-03-25T22:05:50.850ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71042025-03-25T22:05:50.852ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6504, tv_nsec: 188508871 } })
71052025-03-25T22:05:50.852ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1171
71062025-03-25T22:05:50.852ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 7.707635ms iteration = 12 status = {"errors":[],"finish_invoked_ok":[]}
71072025-03-25T22:05:50.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
71082025-03-25T22:05:50.852ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71092025-03-25T22:05:50.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71102025-03-25T22:05:50.855ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71112025-03-25T22:05:50.857ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71122025-03-25T22:05:50.857ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
71132025-03-25T22:05:50.857ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71142025-03-25T22:05:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71152025-03-25T22:05:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71162025-03-25T22:05:50.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71172025-03-25T22:05:50.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71182025-03-25T22:05:50.861ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6504, tv_nsec: 198001477 } })
71192025-03-25T22:05:50.862ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1171 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
71202025-03-25T22:05:50.862ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71212025-03-25T22:05:50.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71222025-03-25T22:05:50.894ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71232025-03-25T22:05:50.897ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
71242025-03-25T22:05:50.897ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71252025-03-25T22:05:50.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71262025-03-25T22:05:50.898ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71272025-03-25T22:05:50.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71282025-03-25T22:05:50.900ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 55.068262ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
71292025-03-25T22:05:50.900ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71302025-03-25T22:05:50.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71312025-03-25T22:05:50.902ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71322025-03-25T22:05:50.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71332025-03-25T22:05:50.907ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
71342025-03-25T22:05:50.907ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
71352025-03-25T22:05:50.907ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71362025-03-25T22:05:50.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
71372025-03-25T22:05:50.910ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71382025-03-25T22:05:50.911ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
71392025-03-25T22:05:50.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
71402025-03-25T22:05:50.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
71412025-03-25T22:05:50.913ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
71422025-03-25T22:05:50.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
71432025-03-25T22:05:50.916ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71442025-03-25T22:05:50.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71452025-03-25T22:05:50.917ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
71462025-03-25T22:05:50.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
71472025-03-25T22:05:50.918ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
71482025-03-25T22:05:50.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
71492025-03-25T22:05:50.919ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
71502025-03-25T22:05:50.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
71512025-03-25T22:05:50.920ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71522025-03-25T22:05:50.923ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
71532025-03-25T22:05:50.923ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
71542025-03-25T22:05:50.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
71552025-03-25T22:05:50.924ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 79.635681ms iteration = 12 status = {"errors":[],"requests_created_ok":[]}
71562025-03-25T22:05:50.930ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71572025-03-25T22:05:50.934ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
71582025-03-25T22:05:50.934ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71592025-03-25T22:05:50.935ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71602025-03-25T22:05:50.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71612025-03-25T22:05:50.937ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
71622025-03-25T22:05:50.937ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71632025-03-25T22:05:50.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71642025-03-25T22:05:50.950ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
71652025-03-25T22:05:50.950ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 107.828004ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
71662025-03-25T22:05:50.958ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 115.255283ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
71672025-03-25T22:05:50.967ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
71682025-03-25T22:05:50.967ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
71692025-03-25T22:05:50.967ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71702025-03-25T22:05:50.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
71712025-03-25T22:05:50.969ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
71722025-03-25T22:05:50.969ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
71732025-03-25T22:05:50.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
71742025-03-25T22:05:50.969ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
71752025-03-25T22:05:50.970ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "03246da7-28fa-4a91-ab14-9ce6485b49f3", "content-length": "26", "date": "Tue, 25 Mar 2025 22:05:50 GMT"} })
71762025-03-25T22:05:50.970ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
71772025-03-25T22:05:50.970ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71782025-03-25T22:05:50.970ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71792025-03-25T22:05:50.971ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 126.501839ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
71802025-03-25T22:05:50.971ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
71812025-03-25T22:05:50.972ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
71822025-03-25T22:05:50.972ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 127.235203ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
71832025-03-25T22:05:50.973ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 128.182259ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
71842025-03-25T22:05:50.973ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 128.392243ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
71852025-03-25T22:05:50.973ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
71862025-03-25T22:05:50.973ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71872025-03-25T22:05:50.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71882025-03-25T22:05:50.974ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f034aaf6-2037-4cb4-8409-3ab31c15cc28, lookup_type: ById(f034aaf6-2037-4cb4-8409-3ab31c15cc28) } result = Ok(())
71892025-03-25T22:05:50.974ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71902025-03-25T22:05:50.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71912025-03-25T22:05:50.974ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:360
71922025-03-25T22:05:50.974ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 131.619549ms iteration = 12 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
71932025-03-25T22:05:50.976ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 133.057764ms iteration = 12 status = 0
71942025-03-25T22:05:50.987ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 zone_address = fd00:1122:3344:101::2
71952025-03-25T22:05:50.987ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
71962025-03-25T22:05:50.988ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e33e571e-20d2-414e-b1c9-acbf01c9c54f", "content-length": "26", "date": "Tue, 25 Mar 2025 22:05:50 GMT"} })
71972025-03-25T22:05:50.988ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1184 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
71982025-03-25T22:05:50.989ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
71992025-03-25T22:05:50.991ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 148.182138ms iteration = 14 status = {"physical_disks_added":0}
72002025-03-25T22:05:51.013ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
72012025-03-25T22:05:51.013ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
72022025-03-25T22:05:51.013ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 168.048556ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
72032025-03-25T22:05:51.021ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72042025-03-25T22:05:51.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72052025-03-25T22:05:51.024ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72062025-03-25T22:05:51.026ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
72072025-03-25T22:05:51.026ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72082025-03-25T22:05:51.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72092025-03-25T22:05:51.028ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72102025-03-25T22:05:51.028ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
72112025-03-25T22:05:51.028ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72122025-03-25T22:05:51.028ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5264e3b0-0867-4979-8bb3-7266a5b12f26", "content-length": "26", "date": "Tue, 25 Mar 2025 22:05:50 GMT"} })
72132025-03-25T22:05:51.028ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
72142025-03-25T22:05:51.029ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
72152025-03-25T22:05:51.029ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72162025-03-25T22:05:51.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72172025-03-25T22:05:51.030ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
72182025-03-25T22:05:51.145ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
72192025-03-25T22:05:51.145ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
72202025-03-25T22:05:51.146ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "cd076906-2d37-4705-b62e-ee1187cf7f29", "content-length": "372", "date": "Tue, 25 Mar 2025 22:05:51 GMT"} })
72212025-03-25T22:05:51.146ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72222025-03-25T22:05:51.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72232025-03-25T22:05:51.159ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 316.471868ms iteration = 12 status = {}
72242025-03-25T22:05:51.176ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
72252025-03-25T22:05:51.177ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
72262025-03-25T22:05:51.177ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d7f96a18-b368-4aff-8b7d-df956f198459", "date": "Tue, 25 Mar 2025 22:05:51 GMT"} })
72272025-03-25T22:05:51.177ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72282025-03-25T22:05:51.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72292025-03-25T22:05:51.180ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72302025-03-25T22:05:51.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72312025-03-25T22:05:51.182ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
72322025-03-25T22:05:51.183ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "704737f0-4a1d-4105-8443-349644388570", "content-length": "1", "date": "Tue, 25 Mar 2025 22:05:50 GMT"} })
72332025-03-25T22:05:51.183ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72342025-03-25T22:05:51.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72352025-03-25T22:05:51.184ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
72362025-03-25T22:05:51.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
72372025-03-25T22:05:51.203ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
72382025-03-25T22:05:51.204ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac6dd3a1-e5e6-4052-9bf4-e80ee1459bd5", "content-length": "691", "date": "Tue, 25 Mar 2025 22:05:51 GMT"} })
72392025-03-25T22:05:51.204ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
72402025-03-25T22:05:51.204ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
72412025-03-25T22:05:51.204ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
72422025-03-25T22:05:51.206ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 363.097643ms iteration = 12 status = {}
72432025-03-25T22:05:51.206ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 363.489209ms iteration = 12 status = null
72442025-03-25T22:05:51.207ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
72452025-03-25T22:05:51.207ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
72462025-03-25T22:05:51.208ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "dc69a4c2-9d91-418f-bbd4-c3af817518e6", "date": "Tue, 25 Mar 2025 22:05:51 GMT"} })
72472025-03-25T22:05:51.210ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 365.19263ms iteration = 12 status = {}
72482025-03-25T22:05:51.262ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72492025-03-25T22:05:51.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72502025-03-25T22:05:51.264ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a5db250-fa3f-4168-ab16-5c36568c22e2, rack_id: c7210e4b-5a81-4ec8-b8fe-816a9508dc74, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(6d5dda50-e3c4-4853-9bfa-a66b447ab351) } rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
72512025-03-25T22:05:51.264ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72522025-03-25T22:05:51.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72532025-03-25T22:05:51.276ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
72542025-03-25T22:05:51.276ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "84206e55-9d73-40d3-afcf-f60559e8423e", "content-length": "134", "date": "Tue, 25 Mar 2025 22:05:50 GMT"} })
72552025-03-25T22:05:51.276ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
72562025-03-25T22:05:51.276ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 6d5dda50-e3c4-4853-9bfa-a66b447ab351
72572025-03-25T22:05:51.277ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
72582025-03-25T22:05:51.277ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
72592025-03-25T22:05:51.277ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72602025-03-25T22:05:51.277ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72612025-03-25T22:05:51.277ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72622025-03-25T22:05:51.277ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
72632025-03-25T22:05:51.277ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72642025-03-25T22:05:51.277ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
72652025-03-25T22:05:51.277ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
72662025-03-25T22:05:51.277ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72672025-03-25T22:05:51.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72682025-03-25T22:05:51.280ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
72692025-03-25T22:05:51.280ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b2512d4-a0b3-4a8e-87f2-ae8b129e4bcd", "content-length": "2", "date": "Tue, 25 Mar 2025 22:05:50 GMT"} })
72702025-03-25T22:05:51.280ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
72712025-03-25T22:05:51.280ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "bbea5d65-b75b-41b3-80bc-4239134b8b17", "content-length": "52", "date": "Tue, 25 Mar 2025 22:05:50 GMT"} })
72722025-03-25T22:05:51.280ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
72732025-03-25T22:05:51.280ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
72742025-03-25T22:05:51.429ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "dd9d2b35-7805-40f7-bd80-4330ebe6fc26", "date": "Tue, 25 Mar 2025 22:05:51 GMT"} })
72752025-03-25T22:05:51.429ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch = Switch0
72762025-03-25T22:05:51.429ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
72772025-03-25T22:05:51.433ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "400ae692-3431-464a-afeb-f75c17a2d9b6", "content-length": "682", "date": "Tue, 25 Mar 2025 22:05:51 GMT"} })
72782025-03-25T22:05:51.434ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72792025-03-25T22:05:51.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72802025-03-25T22:05:51.438ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72812025-03-25T22:05:51.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72822025-03-25T22:05:51.441ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72832025-03-25T22:05:51.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72842025-03-25T22:05:51.443ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72852025-03-25T22:05:51.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72862025-03-25T22:05:51.449ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 606.705518ms iteration = 12 status = {}
72872025-03-25T22:05:51.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = fc24fe67-998c-43c1-b901-87b5132bde24 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
72882025-03-25T22:05:51.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = fc24fe67-998c-43c1-b901-87b5132bde24 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
72892025-03-25T22:05:51.613ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2435 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = fc24fe67-998c-43c1-b901-87b5132bde24 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
72902025-03-25T22:05:52.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6bd17682-bb23-4ab6-9125-2c09b1362694 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
72912025-03-25T22:05:52.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6bd17682-bb23-4ab6-9125-2c09b1362694 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
72922025-03-25T22:05:52.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1991 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6bd17682-bb23-4ab6-9125-2c09b1362694 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
72932025-03-25T22:05:53.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c30333b1-dbca-44c7-b39e-8b3f1da6a9ec roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
72942025-03-25T22:05:53.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c30333b1-dbca-44c7-b39e-8b3f1da6a9ec resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
72952025-03-25T22:05:53.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1734 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c30333b1-dbca-44c7-b39e-8b3f1da6a9ec response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
72962025-03-25T22:05:54.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d7c8bf4e-4fb1-4db2-9262-a43fe471f8a6 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
72972025-03-25T22:05:54.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d7c8bf4e-4fb1-4db2-9262-a43fe471f8a6 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
72982025-03-25T22:05:54.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2720 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d7c8bf4e-4fb1-4db2-9262-a43fe471f8a6 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
72992025-03-25T22:05:55.697ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d6664874-2c9e-4bda-9f3c-65cebdab9855 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73002025-03-25T22:05:55.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d6664874-2c9e-4bda-9f3c-65cebdab9855 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73012025-03-25T22:05:55.700ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3059 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d6664874-2c9e-4bda-9f3c-65cebdab9855 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73022025-03-25T22:05:56.719ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 481a831c-a361-4f9b-848a-65f7aa18e730 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73032025-03-25T22:05:56.719ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 481a831c-a361-4f9b-848a-65f7aa18e730 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73042025-03-25T22:05:56.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2270 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 481a831c-a361-4f9b-848a-65f7aa18e730 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73052025-03-25T22:05:57.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 557935ae-f0e4-4384-bad9-1fa8bb0ee030 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73062025-03-25T22:05:57.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 557935ae-f0e4-4384-bad9-1fa8bb0ee030 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73072025-03-25T22:05:57.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2326 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 557935ae-f0e4-4384-bad9-1fa8bb0ee030 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73082025-03-25T22:05:58.572ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 621 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = 92e3cf7d-049d-44a9-b0f8-de14ccf7f4c2 response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
73092025-03-25T22:05:58.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 79e5981c-67e3-4f8f-b7b3-74e9ef4aaf5b roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73102025-03-25T22:05:58.764ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 79e5981c-67e3-4f8f-b7b3-74e9ef4aaf5b resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73112025-03-25T22:05:58.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1842 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 79e5981c-67e3-4f8f-b7b3-74e9ef4aaf5b response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73122025-03-25T22:05:59.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 94827782-4018-4538-a20e-1c44f3db1dea roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73132025-03-25T22:05:59.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 94827782-4018-4538-a20e-1c44f3db1dea resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73142025-03-25T22:05:59.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2020 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 94827782-4018-4538-a20e-1c44f3db1dea response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73152025-03-25T22:06:00.806ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 09e7cae1-eb5b-4c17-9653-dd86cd00d89f roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73162025-03-25T22:06:00.807ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 09e7cae1-eb5b-4c17-9653-dd86cd00d89f resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73172025-03-25T22:06:00.809ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2227 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 09e7cae1-eb5b-4c17-9653-dd86cd00d89f response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73182025-03-25T22:06:00.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
73192025-03-25T22:06:00.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73202025-03-25T22:06:00.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73212025-03-25T22:06:00.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
73222025-03-25T22:06:00.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73232025-03-25T22:06:00.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73242025-03-25T22:06:00.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73252025-03-25T22:06:00.846ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73262025-03-25T22:06:00.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73272025-03-25T22:06:00.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
73282025-03-25T22:06:00.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73292025-03-25T22:06:00.848ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.953839ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
73302025-03-25T22:06:00.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73312025-03-25T22:06:00.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73322025-03-25T22:06:00.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73332025-03-25T22:06:00.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73342025-03-25T22:06:00.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
73352025-03-25T22:06:00.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73362025-03-25T22:06:00.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73372025-03-25T22:06:00.860ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
73382025-03-25T22:06:00.860ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.319902ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
73392025-03-25T22:06:01.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1474f1e0-9746-4ab7-b905-5499232881e4 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73402025-03-25T22:06:01.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1474f1e0-9746-4ab7-b905-5499232881e4 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73412025-03-25T22:06:01.830ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2313 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1474f1e0-9746-4ab7-b905-5499232881e4 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73422025-03-25T22:06:02.850ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c9898a44-b045-4353-b844-fb54085d91db roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73432025-03-25T22:06:02.850ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c9898a44-b045-4353-b844-fb54085d91db resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73442025-03-25T22:06:02.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2033 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c9898a44-b045-4353-b844-fb54085d91db response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73452025-03-25T22:06:03.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 405fede3-f494-4946-afe7-7e0e33c1eb5e roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73462025-03-25T22:06:03.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 405fede3-f494-4946-afe7-7e0e33c1eb5e resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73472025-03-25T22:06:03.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2342 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 405fede3-f494-4946-afe7-7e0e33c1eb5e response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73482025-03-25T22:06:04.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8d5e5a91-ef9d-47f8-93fe-50df194a7ead roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73492025-03-25T22:06:04.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8d5e5a91-ef9d-47f8-93fe-50df194a7ead resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73502025-03-25T22:06:04.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2726 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8d5e5a91-ef9d-47f8-93fe-50df194a7ead response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73512025-03-25T22:06:05.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 55e38a30-76d1-4418-ae75-0c0cb685f01e roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73522025-03-25T22:06:05.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 55e38a30-76d1-4418-ae75-0c0cb685f01e resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73532025-03-25T22:06:05.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2538 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 55e38a30-76d1-4418-ae75-0c0cb685f01e response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73542025-03-25T22:06:06.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1fd4932d-64e8-4dd8-8de9-4138987d97ca roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73552025-03-25T22:06:06.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1fd4932d-64e8-4dd8-8de9-4138987d97ca resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73562025-03-25T22:06:06.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2090 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1fd4932d-64e8-4dd8-8de9-4138987d97ca response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73572025-03-25T22:06:07.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 170fd9cc-6605-4348-87fb-c97d4fbe8ab1 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73582025-03-25T22:06:07.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 170fd9cc-6605-4348-87fb-c97d4fbe8ab1 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73592025-03-25T22:06:07.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1889 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 170fd9cc-6605-4348-87fb-c97d4fbe8ab1 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73602025-03-25T22:06:08.573ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 832 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = 7c1e03c4-f2f1-48fc-8342-d3f8b87a8719 response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
73612025-03-25T22:06:08.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 62c1671a-2264-4e1d-b45c-30e2a920e527 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73622025-03-25T22:06:08.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 62c1671a-2264-4e1d-b45c-30e2a920e527 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73632025-03-25T22:06:08.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1873 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 62c1671a-2264-4e1d-b45c-30e2a920e527 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73642025-03-25T22:06:10.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a79117ad-18b8-48fe-8821-46fb6be21e66 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73652025-03-25T22:06:10.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a79117ad-18b8-48fe-8821-46fb6be21e66 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73662025-03-25T22:06:10.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2237 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a79117ad-18b8-48fe-8821-46fb6be21e66 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73672025-03-25T22:06:10.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
73682025-03-25T22:06:10.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73692025-03-25T22:06:10.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73702025-03-25T22:06:10.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
73712025-03-25T22:06:10.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73722025-03-25T22:06:10.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73732025-03-25T22:06:10.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73742025-03-25T22:06:10.846ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73752025-03-25T22:06:10.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73762025-03-25T22:06:10.848ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.928489ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
73772025-03-25T22:06:10.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
73782025-03-25T22:06:10.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73792025-03-25T22:06:10.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73802025-03-25T22:06:10.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73812025-03-25T22:06:10.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73822025-03-25T22:06:10.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73832025-03-25T22:06:10.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
73842025-03-25T22:06:10.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73852025-03-25T22:06:10.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73862025-03-25T22:06:10.860ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
73872025-03-25T22:06:10.860ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.806663ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
73882025-03-25T22:06:11.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4d928f7a-b9db-4709-9cf5-16bc426909c2 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73892025-03-25T22:06:11.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4d928f7a-b9db-4709-9cf5-16bc426909c2 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73902025-03-25T22:06:11.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1689 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4d928f7a-b9db-4709-9cf5-16bc426909c2 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73912025-03-25T22:06:12.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f22b49cd-af3f-430b-ae12-554bc05ae7f0 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73922025-03-25T22:06:12.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f22b49cd-af3f-430b-ae12-554bc05ae7f0 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73932025-03-25T22:06:12.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1758 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f22b49cd-af3f-430b-ae12-554bc05ae7f0 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73942025-03-25T22:06:13.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b705a15a-be48-4129-9a95-c4ddc9a467ed roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73952025-03-25T22:06:13.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b705a15a-be48-4129-9a95-c4ddc9a467ed resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73962025-03-25T22:06:13.067ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2381 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b705a15a-be48-4129-9a95-c4ddc9a467ed response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
73972025-03-25T22:06:13.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38741 req_id = 09aaf6f3-f0f7-460f-9656-71d68282ccd3 roles = RoleSet { roles: {} } uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
73982025-03-25T22:06:13.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38741 req_id = 09aaf6f3-f0f7-460f-9656-71d68282ccd3 resource = Database result = Ok(()) uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
73992025-03-25T22:06:13.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2709 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38741 req_id = 09aaf6f3-f0f7-460f-9656-71d68282ccd3 response_code = 200 uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
74002025-03-25T22:06:13.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38741 req_id = 45ad8006-2c8b-4879-916b-e503d74a833a roles = RoleSet { roles: {} } uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
74012025-03-25T22:06:13.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38741 req_id = 45ad8006-2c8b-4879-916b-e503d74a833a resource = Database result = Ok(()) uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
74022025-03-25T22:06:13.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2867 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38741 req_id = 45ad8006-2c8b-4879-916b-e503d74a833a response_code = 200 uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
74032025-03-25T22:06:14.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0a224503-1e37-43af-9fc3-65b5eb458c0e roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
74042025-03-25T22:06:14.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0a224503-1e37-43af-9fc3-65b5eb458c0e resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
74052025-03-25T22:06:14.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2161 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0a224503-1e37-43af-9fc3-65b5eb458c0e response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
74062025-03-25T22:06:15.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7056b0c4-74a5-4dec-ab04-4836402af7dc roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
74072025-03-25T22:06:15.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7056b0c4-74a5-4dec-ab04-4836402af7dc resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
74082025-03-25T22:06:15.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2030 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7056b0c4-74a5-4dec-ab04-4836402af7dc response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
74092025-03-25T22:06:16.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4881e033-8ffb-49f8-b7b9-f5ad7b539bb9 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
74102025-03-25T22:06:16.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4881e033-8ffb-49f8-b7b9-f5ad7b539bb9 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
74112025-03-25T22:06:16.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2364 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4881e033-8ffb-49f8-b7b9-f5ad7b539bb9 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
74122025-03-25T22:06:17.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c4b4c950-0c9e-41fe-b31f-2a34847caa32 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
74132025-03-25T22:06:17.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c4b4c950-0c9e-41fe-b31f-2a34847caa32 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
74142025-03-25T22:06:17.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2705 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c4b4c950-0c9e-41fe-b31f-2a34847caa32 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
74152025-03-25T22:06:18.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = bb2613d6-257a-4560-b5fc-aa36a3ba68ac roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
74162025-03-25T22:06:18.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = bb2613d6-257a-4560-b5fc-aa36a3ba68ac resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
74172025-03-25T22:06:18.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1995 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = bb2613d6-257a-4560-b5fc-aa36a3ba68ac response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
74182025-03-25T22:06:18.572ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 597 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = cfe064ba-ce33-424b-8c4d-5fb2cc8584b7 response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
74192025-03-25T22:06:19.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ae38d1ce-8a0e-4a17-8b28-116947e7e696 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
74202025-03-25T22:06:19.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ae38d1ce-8a0e-4a17-8b28-116947e7e696 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
74212025-03-25T22:06:19.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2367 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ae38d1ce-8a0e-4a17-8b28-116947e7e696 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
74222025-03-25T22:06:20.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c3f33f14-9581-4854-9986-44735ea850e3 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
74232025-03-25T22:06:20.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c3f33f14-9581-4854-9986-44735ea850e3 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
74242025-03-25T22:06:20.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2120 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c3f33f14-9581-4854-9986-44735ea850e3 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
74252025-03-25T22:06:20.843ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
74262025-03-25T22:06:20.843ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
74272025-03-25T22:06:20.843ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
74282025-03-25T22:06:20.843ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
74292025-03-25T22:06:20.843ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74302025-03-25T22:06:20.843ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
74312025-03-25T22:06:20.843ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
74322025-03-25T22:06:20.843ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 13 reason = Timeout
74332025-03-25T22:06:20.843ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
74342025-03-25T22:06:20.843ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
74352025-03-25T22:06:20.843ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
74362025-03-25T22:06:20.843ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
74372025-03-25T22:06:20.843ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
74382025-03-25T22:06:20.843ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
74392025-03-25T22:06:20.843ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
74402025-03-25T22:06:20.843ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
74412025-03-25T22:06:20.843ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
74422025-03-25T22:06:20.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
74432025-03-25T22:06:20.843ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:82 reason = blueprint disabled target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7
74442025-03-25T22:06:20.843ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 24.46\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7"}
74452025-03-25T22:06:20.843ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
74462025-03-25T22:06:20.843ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
74472025-03-25T22:06:20.843ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-03-25 21:56:20.843637590 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
74482025-03-25T22:06:20.843ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
74492025-03-25T22:06:20.843ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
74502025-03-25T22:06:20.843ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
74512025-03-25T22:06:20.843ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
74522025-03-25T22:06:20.843ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
74532025-03-25T22:06:20.843ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
74542025-03-25T22:06:20.843ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
74552025-03-25T22:06:20.843ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
74562025-03-25T22:06:20.843ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74572025-03-25T22:06:20.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
74582025-03-25T22:06:20.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74592025-03-25T22:06:20.843ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
74602025-03-25T22:06:20.843ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
74612025-03-25T22:06:20.843ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
74622025-03-25T22:06:20.843ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
74632025-03-25T22:06:20.843ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74642025-03-25T22:06:20.843ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
74652025-03-25T22:06:20.843ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
74662025-03-25T22:06:20.843ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
74672025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
74682025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
74692025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
74702025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
74712025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74722025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
74732025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
74742025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 13 reason = Timeout
74752025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
74762025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
74772025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
74782025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
74792025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
74802025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
74812025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
74822025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
74832025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
74842025-03-25T22:06:20.844ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
74852025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74862025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
74872025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
74882025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
74892025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
74902025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
74912025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
74922025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
74932025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74942025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
74952025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
74962025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
74972025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
74982025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
74992025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
75002025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
75012025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
75022025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75032025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
75042025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
75052025-03-25T22:06:20.844ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5533f428-2028-4269-b7b1-f15912c01133.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("66b022b6-2e12-413e-b4b7-56c4ad5bdd77.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f337d25b-c67a-4a32-89e1-e187aea97ed9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f337d25b-c67a-4a32-89e1-e187aea97ed9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 6534, tv_nsec: 180641694 } })
75062025-03-25T22:06:20.844ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("58d382a7-99da-40a7-bc9f-2da7e9b156c1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d42076c6-06fe-4102-a978-c7d0a8dffb98.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d42076c6-06fe-4102-a978-c7d0a8dffb98.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 6534, tv_nsec: 180631424 } })
75072025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
75082025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75092025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75102025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
75112025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
75122025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
75132025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
75142025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
75152025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
75162025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75172025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
75182025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
75192025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
75202025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
75212025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
75222025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
75232025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
75242025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75252025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
75262025-03-25T22:06:20.844ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
75272025-03-25T22:06:20.845ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
75282025-03-25T22:06:20.845ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.593618ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
75292025-03-25T22:06:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
75302025-03-25T22:06:20.845ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
75312025-03-25T22:06:20.845ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
75322025-03-25T22:06:20.845ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.619468ms iteration = 7 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
75332025-03-25T22:06:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
75342025-03-25T22:06:20.845ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75352025-03-25T22:06:20.846ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
75362025-03-25T22:06:20.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
75372025-03-25T22:06:20.846ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75382025-03-25T22:06:20.847ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.060641ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
75392025-03-25T22:06:20.847ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75402025-03-25T22:06:20.847ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75412025-03-25T22:06:20.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
75422025-03-25T22:06:20.848ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75432025-03-25T22:06:20.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75442025-03-25T22:06:20.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
75452025-03-25T22:06:20.849ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
75462025-03-25T22:06:20.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
75472025-03-25T22:06:20.850ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
75482025-03-25T22:06:20.850ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
75492025-03-25T22:06:20.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
75502025-03-25T22:06:20.850ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75512025-03-25T22:06:20.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
75522025-03-25T22:06:20.850ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-03-25 21:56:20.843637590 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
75532025-03-25T22:06:20.850ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 6.820219ms iteration = 7 status = {"expiration":"2025-03-25T21:56:20.843637590Z","pruned":[]}
75542025-03-25T22:06:20.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75552025-03-25T22:06:20.852ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75562025-03-25T22:06:20.852ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6534, tv_nsec: 188404930 } })
75572025-03-25T22:06:20.852ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1171
75582025-03-25T22:06:20.852ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75592025-03-25T22:06:20.854ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6534, tv_nsec: 190135690 } })
75602025-03-25T22:06:20.854ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1171
75612025-03-25T22:06:20.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
75622025-03-25T22:06:20.854ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
75632025-03-25T22:06:20.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
75642025-03-25T22:06:20.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
75652025-03-25T22:06:20.854ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
75662025-03-25T22:06:20.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
75672025-03-25T22:06:20.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75682025-03-25T22:06:20.856ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75692025-03-25T22:06:20.857ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
75702025-03-25T22:06:20.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
75712025-03-25T22:06:20.857ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75722025-03-25T22:06:20.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
75732025-03-25T22:06:20.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75742025-03-25T22:06:20.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75752025-03-25T22:06:20.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
75762025-03-25T22:06:20.860ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75772025-03-25T22:06:20.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75782025-03-25T22:06:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
75792025-03-25T22:06:20.861ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
75802025-03-25T22:06:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
75812025-03-25T22:06:20.862ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75822025-03-25T22:06:20.863ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 19.082343ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
75832025-03-25T22:06:20.864ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
75842025-03-25T22:06:20.864ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75852025-03-25T22:06:20.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75862025-03-25T22:06:20.867ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 23.588741ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
75872025-03-25T22:06:20.869ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75882025-03-25T22:06:20.871ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
75892025-03-25T22:06:20.871ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
75902025-03-25T22:06:20.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
75912025-03-25T22:06:20.871ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75922025-03-25T22:06:20.874ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
75932025-03-25T22:06:20.874ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
75942025-03-25T22:06:20.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
75952025-03-25T22:06:20.876ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75962025-03-25T22:06:20.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75972025-03-25T22:06:20.878ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
75982025-03-25T22:06:20.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
75992025-03-25T22:06:20.878ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76002025-03-25T22:06:20.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76012025-03-25T22:06:20.882ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76022025-03-25T22:06:20.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76032025-03-25T22:06:20.906ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 62.072924ms iteration = 13 status = {"errors":[],"requests_created_ok":[]}
76042025-03-25T22:06:20.910ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6534, tv_nsec: 246633327 } })
76052025-03-25T22:06:20.910ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1171 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
76062025-03-25T22:06:20.914ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76072025-03-25T22:06:20.917ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
76082025-03-25T22:06:20.917ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76092025-03-25T22:06:20.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76102025-03-25T22:06:20.922ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 78.783997ms iteration = 13 status = {"errors":[],"finish_invoked_ok":[]}
76112025-03-25T22:06:20.924ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
76122025-03-25T22:06:20.925ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
76132025-03-25T22:06:20.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
76142025-03-25T22:06:20.925ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
76152025-03-25T22:06:20.925ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
76162025-03-25T22:06:20.925ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76172025-03-25T22:06:20.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
76182025-03-25T22:06:20.925ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76192025-03-25T22:06:20.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76202025-03-25T22:06:20.927ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
76212025-03-25T22:06:20.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
76222025-03-25T22:06:20.928ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76232025-03-25T22:06:20.928ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76242025-03-25T22:06:20.930ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
76252025-03-25T22:06:20.930ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
76262025-03-25T22:06:20.930ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
76272025-03-25T22:06:20.930ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
76282025-03-25T22:06:20.930ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 86.086944ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
76292025-03-25T22:06:20.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
76302025-03-25T22:06:20.931ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
76312025-03-25T22:06:20.931ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
76322025-03-25T22:06:20.932ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76332025-03-25T22:06:20.932ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
76342025-03-25T22:06:20.932ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
76352025-03-25T22:06:20.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
76362025-03-25T22:06:20.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
76372025-03-25T22:06:20.934ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76382025-03-25T22:06:20.934ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
76392025-03-25T22:06:20.935ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
76402025-03-25T22:06:20.935ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76412025-03-25T22:06:20.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
76422025-03-25T22:06:20.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76432025-03-25T22:06:20.936ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76442025-03-25T22:06:20.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76452025-03-25T22:06:20.936ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
76462025-03-25T22:06:20.936ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
76472025-03-25T22:06:20.936ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 93.30113ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
76482025-03-25T22:06:20.937ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76492025-03-25T22:06:20.939ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
76502025-03-25T22:06:20.941ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
76512025-03-25T22:06:20.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
76522025-03-25T22:06:20.942ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
76532025-03-25T22:06:20.942ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76542025-03-25T22:06:20.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76552025-03-25T22:06:20.950ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 107.019779ms iteration = 4 status = {"nsuccess":5}
76562025-03-25T22:06:20.954ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76572025-03-25T22:06:20.958ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
76582025-03-25T22:06:20.964ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
76592025-03-25T22:06:20.964ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 120.747119ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
76602025-03-25T22:06:20.967ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76612025-03-25T22:06:20.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76622025-03-25T22:06:20.976ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
76632025-03-25T22:06:20.978ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76642025-03-25T22:06:20.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76652025-03-25T22:06:20.979ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
76662025-03-25T22:06:20.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
76672025-03-25T22:06:20.980ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
76682025-03-25T22:06:20.980ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 137.275448ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
76692025-03-25T22:06:20.987ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 143.971925ms iteration = 15 status = {"physical_disks_added":0}
76702025-03-25T22:06:20.988ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76712025-03-25T22:06:20.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76722025-03-25T22:06:20.990ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
76732025-03-25T22:06:20.990ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76742025-03-25T22:06:20.992ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
76752025-03-25T22:06:20.992ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76762025-03-25T22:06:20.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76772025-03-25T22:06:20.995ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76782025-03-25T22:06:20.998ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
76792025-03-25T22:06:20.998ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76802025-03-25T22:06:20.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76812025-03-25T22:06:21.003ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
76822025-03-25T22:06:21.003ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
76832025-03-25T22:06:21.003ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
76842025-03-25T22:06:21.003ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
76852025-03-25T22:06:21.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
76862025-03-25T22:06:21.006ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
76872025-03-25T22:06:21.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
76882025-03-25T22:06:21.010ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 166.728492ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
76892025-03-25T22:06:21.011ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 167.809172ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
76902025-03-25T22:06:21.012ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
76912025-03-25T22:06:21.012ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
76922025-03-25T22:06:21.013ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76932025-03-25T22:06:21.013ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
76942025-03-25T22:06:21.013ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
76952025-03-25T22:06:21.013ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
76962025-03-25T22:06:21.013ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "076a967a-9a37-4550-80ab-e113f10fd1e9", "content-length": "26", "date": "Tue, 25 Mar 2025 22:06:21 GMT"} })
76972025-03-25T22:06:21.013ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
76982025-03-25T22:06:21.013ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
76992025-03-25T22:06:21.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
77002025-03-25T22:06:21.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
77012025-03-25T22:06:21.014ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
77022025-03-25T22:06:21.014ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
77032025-03-25T22:06:21.015ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6a6979a-4366-44ed-a94c-175279fc340d", "content-length": "26", "date": "Tue, 25 Mar 2025 22:06:21 GMT"} })
77042025-03-25T22:06:21.015ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
77052025-03-25T22:06:21.017ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
77062025-03-25T22:06:21.017ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77072025-03-25T22:06:21.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77082025-03-25T22:06:21.018ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
77092025-03-25T22:06:21.019ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
77102025-03-25T22:06:21.020ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 176.3278ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
77112025-03-25T22:06:21.022ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
77122025-03-25T22:06:21.022ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
77132025-03-25T22:06:21.022ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
77142025-03-25T22:06:21.022ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
77152025-03-25T22:06:21.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
77162025-03-25T22:06:21.023ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77172025-03-25T22:06:21.025ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
77182025-03-25T22:06:21.025ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
77192025-03-25T22:06:21.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
77202025-03-25T22:06:21.030ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77212025-03-25T22:06:21.033ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f034aaf6-2037-4cb4-8409-3ab31c15cc28, lookup_type: ById(f034aaf6-2037-4cb4-8409-3ab31c15cc28) } result = Ok(())
77222025-03-25T22:06:21.033ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77232025-03-25T22:06:21.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77242025-03-25T22:06:21.051ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 207.378682ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
77252025-03-25T22:06:21.085ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 zone_address = fd00:1122:3344:101::2
77262025-03-25T22:06:21.085ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
77272025-03-25T22:06:21.085ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d4f9d529-1184-401f-87d8-b296a2ec7e4b", "content-length": "26", "date": "Tue, 25 Mar 2025 22:06:21 GMT"} })
77282025-03-25T22:06:21.085ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1184 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
77292025-03-25T22:06:21.087ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
77302025-03-25T22:06:21.141ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
77312025-03-25T22:06:21.141ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 297.741041ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
77322025-03-25T22:06:21.196ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
77332025-03-25T22:06:21.196ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "2c37c42b-dd13-4b8e-8d08-1c961e8cba06", "date": "Tue, 25 Mar 2025 22:06:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
77342025-03-25T22:06:21.197ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
77352025-03-25T22:06:21.198ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "f1c6a03b-2dca-463f-bfe8-d7a8646ad979", "date": "Tue, 25 Mar 2025 22:06:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
77362025-03-25T22:06:21.198ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
77372025-03-25T22:06:21.199ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
77382025-03-25T22:06:21.199ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 355.937347ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
77392025-03-25T22:06:21.222ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
77402025-03-25T22:06:21.222ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "956d183a-4757-4a96-8c10-1768d2df7ef0", "content-length": "1", "date": "Tue, 25 Mar 2025 22:06:21 GMT"} })
77412025-03-25T22:06:21.223ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
77422025-03-25T22:06:21.223ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
77432025-03-25T22:06:21.223ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "4bce91a0-6eb2-4493-a589-481a6247a47d", "content-length": "372", "date": "Tue, 25 Mar 2025 22:06:21 GMT"} })
77442025-03-25T22:06:21.223ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77452025-03-25T22:06:21.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77462025-03-25T22:06:21.224ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
77472025-03-25T22:06:21.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
77482025-03-25T22:06:21.230ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 386.250377ms iteration = 13 status = {}
77492025-03-25T22:06:21.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 51defe98-aecc-40bf-8dde-13fdca7d7b8c roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
77502025-03-25T22:06:21.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 51defe98-aecc-40bf-8dde-13fdca7d7b8c resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
77512025-03-25T22:06:21.279ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
77522025-03-25T22:06:21.299ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
77532025-03-25T22:06:21.299ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f4acf298-0dcd-4967-8faa-b8e31627a905", "content-length": "691", "date": "Tue, 25 Mar 2025 22:06:21 GMT"} })
77542025-03-25T22:06:21.299ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
77552025-03-25T22:06:21.299ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
77562025-03-25T22:06:21.299ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
77572025-03-25T22:06:21.301ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 457.286408ms iteration = 13 status = {}
77582025-03-25T22:06:21.301ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77592025-03-25T22:06:21.303ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
77602025-03-25T22:06:21.303ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
77612025-03-25T22:06:21.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
77622025-03-25T22:06:21.305ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 462.063482ms iteration = 13 status = 0
77632025-03-25T22:06:21.306ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 463.008478ms iteration = 13 status = null
77642025-03-25T22:06:21.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 64051 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 51defe98-aecc-40bf-8dde-13fdca7d7b8c response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
77652025-03-25T22:06:21.333ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77662025-03-25T22:06:21.338ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
77672025-03-25T22:06:21.338ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
77682025-03-25T22:06:21.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
77692025-03-25T22:06:21.341ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
77702025-03-25T22:06:21.341ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
77712025-03-25T22:06:21.341ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 497.601662ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
77722025-03-25T22:06:21.342ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:360
77732025-03-25T22:06:21.342ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 498.999296ms iteration = 13 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
77742025-03-25T22:06:21.343ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
77752025-03-25T22:06:21.343ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 23d93905-7b89-4296-b050-7ff9ae235c15 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
77762025-03-25T22:06:21.343ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77772025-03-25T22:06:21.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77782025-03-25T22:06:21.345ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77792025-03-25T22:06:21.348ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
77802025-03-25T22:06:21.348ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77812025-03-25T22:06:21.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77822025-03-25T22:06:21.349ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-03-25T22:00:16.382271Z, time_modified: 2025-03-25T22:00:16.382271Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, db_silo: Silo { identity: SiloIdentity { id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-25T22:00:22.501108Z, time_modified: 2025-03-25T22:00:22.501108Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, db_silo: Silo { identity: SiloIdentity { id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-25T22:00:22.501108Z, time_modified: 2025-03-25T22:00:22.501108Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d" }] }) }
77832025-03-25T22:06:21.349ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 505.793515ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"5c35ff8c-21dd-48b9-9751-76bfa681bc38","tls_certs":["0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d"]}},"default_endpoint":{"silo_id":"5c35ff8c-21dd-48b9-9751-76bfa681bc38","tls_certs":["0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
77842025-03-25T22:06:21.350ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 23d93905-7b89-4296-b050-7ff9ae235c15 dns_zone_name = control-plane.oxide.internal found_so_far = 52 version = 1
77852025-03-25T22:06:21.350ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
77862025-03-25T22:06:21.350ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-03-25 22:00:21.368103 UTC dns_group = internal generation = 1
77872025-03-25T22:06:21.350ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 507.326772ms iteration = 7 status = {"generation":1}
77882025-03-25T22:06:21.360ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
77892025-03-25T22:06:21.360ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
77902025-03-25T22:06:21.360ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "fba39e5b-7d9d-4490-a506-1a30df356bf1", "date": "Tue, 25 Mar 2025 22:06:21 GMT"} })
77912025-03-25T22:06:21.360ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77922025-03-25T22:06:21.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77932025-03-25T22:06:21.362ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77942025-03-25T22:06:21.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77952025-03-25T22:06:21.365ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77962025-03-25T22:06:21.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77972025-03-25T22:06:21.366ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
77982025-03-25T22:06:21.367ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "184b1d77-9723-45c8-8294-11123f36985b", "date": "Tue, 25 Mar 2025 22:06:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
77992025-03-25T22:06:21.367ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
78002025-03-25T22:06:21.368ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
78012025-03-25T22:06:21.368ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
78022025-03-25T22:06:21.368ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "af54707a-428b-49ca-83d2-1ae98a9c1df6", "date": "Tue, 25 Mar 2025 22:06:21 GMT"} })
78032025-03-25T22:06:21.369ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "1bc001c7-b1bd-4516-9253-5bab72982dc3", "date": "Tue, 25 Mar 2025 22:06:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
78042025-03-25T22:06:21.369ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
78052025-03-25T22:06:21.370ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 526.215262ms iteration = 13 status = {}
78062025-03-25T22:06:21.370ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
78072025-03-25T22:06:21.370ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 96679ce4-e18c-487b-803a-7b26be55e85c dns_zone_name = oxide.test found_so_far = 0 version = 2
78082025-03-25T22:06:21.370ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
78092025-03-25T22:06:21.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
78102025-03-25T22:06:21.371ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "605ad806-dc6b-42ad-ae33-2557d8bd3d2d", "date": "Tue, 25 Mar 2025 22:06:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
78112025-03-25T22:06:21.371ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
78122025-03-25T22:06:21.371ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78132025-03-25T22:06:21.373ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
78142025-03-25T22:06:21.373ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 529.297856ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
78152025-03-25T22:06:21.374ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
78162025-03-25T22:06:21.374ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
78172025-03-25T22:06:21.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
78182025-03-25T22:06:21.376ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 96679ce4-e18c-487b-803a-7b26be55e85c dns_zone_name = oxide.test found_so_far = 1 version = 2
78192025-03-25T22:06:21.376ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
78202025-03-25T22:06:21.376ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-03-25 22:00:22.561696 UTC dns_group = external generation = 2
78212025-03-25T22:06:21.376ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 533.041731ms iteration = 7 status = {"generation":2}
78222025-03-25T22:06:21.380ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78232025-03-25T22:06:21.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78242025-03-25T22:06:21.383ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a5db250-fa3f-4168-ab16-5c36568c22e2, rack_id: c7210e4b-5a81-4ec8-b8fe-816a9508dc74, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(6d5dda50-e3c4-4853-9bfa-a66b447ab351) } rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
78252025-03-25T22:06:21.383ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78262025-03-25T22:06:21.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78272025-03-25T22:06:21.398ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
78282025-03-25T22:06:21.399ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "204e74c8-0d24-41e6-a923-2158620231a4", "content-length": "134", "date": "Tue, 25 Mar 2025 22:06:21 GMT"} })
78292025-03-25T22:06:21.399ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
78302025-03-25T22:06:21.399ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 6d5dda50-e3c4-4853-9bfa-a66b447ab351
78312025-03-25T22:06:21.399ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
78322025-03-25T22:06:21.399ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
78332025-03-25T22:06:21.399ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
78342025-03-25T22:06:21.399ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
78352025-03-25T22:06:21.399ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
78362025-03-25T22:06:21.399ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
78372025-03-25T22:06:21.399ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
78382025-03-25T22:06:21.399ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
78392025-03-25T22:06:21.400ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
78402025-03-25T22:06:21.400ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78412025-03-25T22:06:21.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78422025-03-25T22:06:21.401ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
78432025-03-25T22:06:21.401ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d7a6837-903e-4807-8182-5d8073c194e3", "content-length": "2", "date": "Tue, 25 Mar 2025 22:06:21 GMT"} })
78442025-03-25T22:06:21.402ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
78452025-03-25T22:06:21.402ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "db881915-a4bf-4685-af3f-586284a075dc", "content-length": "52", "date": "Tue, 25 Mar 2025 22:06:21 GMT"} })
78462025-03-25T22:06:21.402ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
78472025-03-25T22:06:21.402ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
78482025-03-25T22:06:21.542ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ae1faafe-058d-4ca6-bbba-543319b0b839", "date": "Tue, 25 Mar 2025 22:06:21 GMT"} })
78492025-03-25T22:06:21.542ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch = Switch0
78502025-03-25T22:06:21.542ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
78512025-03-25T22:06:21.543ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "196b5f2d-24fe-43e4-8b63-341b1fa792e5", "content-length": "682", "date": "Tue, 25 Mar 2025 22:06:21 GMT"} })
78522025-03-25T22:06:21.543ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78532025-03-25T22:06:21.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78542025-03-25T22:06:21.547ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78552025-03-25T22:06:21.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78562025-03-25T22:06:21.549ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78572025-03-25T22:06:21.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78582025-03-25T22:06:21.552ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78592025-03-25T22:06:21.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78602025-03-25T22:06:21.554ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
78612025-03-25T22:06:21.554ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
78622025-03-25T22:06:21.559ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 715.527848ms iteration = 13 status = {}
78632025-03-25T22:06:21.587ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
78642025-03-25T22:06:21.587ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:44199
78652025-03-25T22:06:21.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:44199 req_id = adcbbb72-91ae-480b-8fce-57afc238bbb1 roles = RoleSet { roles: {} } uri = /metrics/producers
78662025-03-25T22:06:21.588ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:44199 req_id = adcbbb72-91ae-480b-8fce-57afc238bbb1 resource = Database result = Ok(()) uri = /metrics/producers
78672025-03-25T22:06:21.625ZINFOnexus: assigned collector to new producer collector_id = ec539d60-a406-4fe9-a658-fbc8b3fb545b file = nexus/src/app/oximeter.rs:76 producer_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
78682025-03-25T22:06:21.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 37503 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:44199 req_id = adcbbb72-91ae-480b-8fce-57afc238bbb1 response_code = 201 uri = /metrics/producers
78692025-03-25T22:06:21.625ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "adcbbb72-91ae-480b-8fce-57afc238bbb1", "content-length": "41", "date": "Tue, 25 Mar 2025 22:06:21 GMT"} })
78702025-03-25T22:06:21.627ZDEBGnexus (producer-registration-task): registered with nexus successfully
78712025-03-25T22:06:21.627ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
78722025-03-25T22:06:22.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b6e2ca90-28f7-4991-b9f3-a165e4de4eb3 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
78732025-03-25T22:06:22.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b6e2ca90-28f7-4991-b9f3-a165e4de4eb3 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
78742025-03-25T22:06:22.336ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2605 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b6e2ca90-28f7-4991-b9f3-a165e4de4eb3 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
78752025-03-25T22:06:23.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 59e63922-1fdf-4a48-ab65-941575f2d332 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
78762025-03-25T22:06:23.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 59e63922-1fdf-4a48-ab65-941575f2d332 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
78772025-03-25T22:06:23.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2545 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 59e63922-1fdf-4a48-ab65-941575f2d332 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
78782025-03-25T22:06:24.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0e613f6f-239f-41b4-b994-77f49b8021d9 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
78792025-03-25T22:06:24.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0e613f6f-239f-41b4-b994-77f49b8021d9 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
78802025-03-25T22:06:24.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3047 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0e613f6f-239f-41b4-b994-77f49b8021d9 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
78812025-03-25T22:06:25.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e9ce5288-90a8-4dda-8e83-c0c16d425d98 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
78822025-03-25T22:06:25.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e9ce5288-90a8-4dda-8e83-c0c16d425d98 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
78832025-03-25T22:06:25.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1994 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e9ce5288-90a8-4dda-8e83-c0c16d425d98 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
78842025-03-25T22:06:26.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e4979868-b98a-46d7-9317-d34d502f7ba5 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
78852025-03-25T22:06:26.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e4979868-b98a-46d7-9317-d34d502f7ba5 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
78862025-03-25T22:06:26.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2783 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e4979868-b98a-46d7-9317-d34d502f7ba5 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
78872025-03-25T22:06:27.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 177a4563-cf3c-4786-94ad-72d409a0ff92 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
78882025-03-25T22:06:27.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 177a4563-cf3c-4786-94ad-72d409a0ff92 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
78892025-03-25T22:06:27.448ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2381 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 177a4563-cf3c-4786-94ad-72d409a0ff92 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
78902025-03-25T22:06:28.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d1b85b2a-0fc5-4d51-9624-5676cd68cd56 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
78912025-03-25T22:06:28.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d1b85b2a-0fc5-4d51-9624-5676cd68cd56 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
78922025-03-25T22:06:28.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2157 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d1b85b2a-0fc5-4d51-9624-5676cd68cd56 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
78932025-03-25T22:06:28.572ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 547 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = 930cd57a-c12a-4094-9e71-56ad1c176529 response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
78942025-03-25T22:06:29.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 16e998e1-286f-4b68-a154-ce9142de82c4 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
78952025-03-25T22:06:29.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 16e998e1-286f-4b68-a154-ce9142de82c4 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
78962025-03-25T22:06:29.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2422 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 16e998e1-286f-4b68-a154-ce9142de82c4 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
78972025-03-25T22:06:30.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 99ab68c5-9aa7-455d-bb65-1a39cf040ac4 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
78982025-03-25T22:06:30.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 99ab68c5-9aa7-455d-bb65-1a39cf040ac4 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
78992025-03-25T22:06:30.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2008 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 99ab68c5-9aa7-455d-bb65-1a39cf040ac4 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79002025-03-25T22:06:30.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
79012025-03-25T22:06:30.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79022025-03-25T22:06:30.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79032025-03-25T22:06:30.845ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
79042025-03-25T22:06:30.845ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79052025-03-25T22:06:30.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79062025-03-25T22:06:30.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79072025-03-25T22:06:30.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
79082025-03-25T22:06:30.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79092025-03-25T22:06:30.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79102025-03-25T22:06:30.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79112025-03-25T22:06:30.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79122025-03-25T22:06:30.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79132025-03-25T22:06:30.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
79142025-03-25T22:06:30.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79152025-03-25T22:06:30.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79162025-03-25T22:06:30.863ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
79172025-03-25T22:06:30.863ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.03179ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
79182025-03-25T22:06:30.874ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79192025-03-25T22:06:30.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79202025-03-25T22:06:30.903ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.753346ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
79212025-03-25T22:06:31.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1e08a6de-d50d-4470-98d7-b2f3d87ea659 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79222025-03-25T22:06:31.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1e08a6de-d50d-4470-98d7-b2f3d87ea659 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79232025-03-25T22:06:31.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2435 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1e08a6de-d50d-4470-98d7-b2f3d87ea659 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79242025-03-25T22:06:32.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4e18da79-b833-43d3-8065-b6578a85af5a roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79252025-03-25T22:06:32.557ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4e18da79-b833-43d3-8065-b6578a85af5a resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79262025-03-25T22:06:32.559ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2503 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4e18da79-b833-43d3-8065-b6578a85af5a response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79272025-03-25T22:06:33.578ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0dd153a2-d1a5-41fd-95c0-7467cb795990 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79282025-03-25T22:06:33.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0dd153a2-d1a5-41fd-95c0-7467cb795990 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79292025-03-25T22:06:33.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2124 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0dd153a2-d1a5-41fd-95c0-7467cb795990 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79302025-03-25T22:06:34.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 05e18ff4-f624-4348-ab7c-61f07e94aff3 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79312025-03-25T22:06:34.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 05e18ff4-f624-4348-ab7c-61f07e94aff3 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79322025-03-25T22:06:34.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1887 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 05e18ff4-f624-4348-ab7c-61f07e94aff3 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79332025-03-25T22:06:35.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = aa69335d-5ee0-4e38-92db-8725ab718ad6 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79342025-03-25T22:06:35.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = aa69335d-5ee0-4e38-92db-8725ab718ad6 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79352025-03-25T22:06:35.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2639 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = aa69335d-5ee0-4e38-92db-8725ab718ad6 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79362025-03-25T22:06:36.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1b24d590-bef6-4f04-8416-ee4178b5bdaa roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79372025-03-25T22:06:36.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1b24d590-bef6-4f04-8416-ee4178b5bdaa resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79382025-03-25T22:06:36.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2440 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1b24d590-bef6-4f04-8416-ee4178b5bdaa response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79392025-03-25T22:06:37.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e2b88455-4a1a-4178-b0d2-8e333706a2d7 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79402025-03-25T22:06:37.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e2b88455-4a1a-4178-b0d2-8e333706a2d7 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79412025-03-25T22:06:37.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2038 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e2b88455-4a1a-4178-b0d2-8e333706a2d7 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79422025-03-25T22:06:38.573ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 767 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = 2227f7d7-0689-48e9-8d51-2ee2a5975a0c response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
79432025-03-25T22:06:38.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6318897b-ff04-4020-af68-69e10004d16c roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79442025-03-25T22:06:38.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6318897b-ff04-4020-af68-69e10004d16c resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79452025-03-25T22:06:38.691ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2892 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6318897b-ff04-4020-af68-69e10004d16c response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79462025-03-25T22:06:39.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0fbd85fa-f2c5-47bf-b1f2-935fc2c94c60 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79472025-03-25T22:06:39.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0fbd85fa-f2c5-47bf-b1f2-935fc2c94c60 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79482025-03-25T22:06:39.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1824 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0fbd85fa-f2c5-47bf-b1f2-935fc2c94c60 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79492025-03-25T22:06:40.732ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = fad2796b-b0b8-4597-8e63-39a192ef3db9 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79502025-03-25T22:06:40.732ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = fad2796b-b0b8-4597-8e63-39a192ef3db9 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79512025-03-25T22:06:40.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2074 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = fad2796b-b0b8-4597-8e63-39a192ef3db9 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79522025-03-25T22:06:40.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
79532025-03-25T22:06:40.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79542025-03-25T22:06:40.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79552025-03-25T22:06:40.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79562025-03-25T22:06:40.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
79572025-03-25T22:06:40.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79582025-03-25T22:06:40.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79592025-03-25T22:06:40.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
79602025-03-25T22:06:40.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79612025-03-25T22:06:40.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79622025-03-25T22:06:40.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79632025-03-25T22:06:40.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79642025-03-25T22:06:40.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79652025-03-25T22:06:40.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
79662025-03-25T22:06:40.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79672025-03-25T22:06:40.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79682025-03-25T22:06:40.862ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
79692025-03-25T22:06:40.862ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.412639ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
79702025-03-25T22:06:40.876ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79712025-03-25T22:06:40.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79722025-03-25T22:06:40.878ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.854341ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
79732025-03-25T22:06:41.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d0814864-e4b6-4e63-b90e-607bab65c6fd roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79742025-03-25T22:06:41.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d0814864-e4b6-4e63-b90e-607bab65c6fd resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79752025-03-25T22:06:41.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2034 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d0814864-e4b6-4e63-b90e-607bab65c6fd response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79762025-03-25T22:06:42.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2520b0c6-f4ff-45bc-bebd-d9dc79d9f5b0 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79772025-03-25T22:06:42.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2520b0c6-f4ff-45bc-bebd-d9dc79d9f5b0 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79782025-03-25T22:06:42.778ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2246 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2520b0c6-f4ff-45bc-bebd-d9dc79d9f5b0 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79792025-03-25T22:06:43.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38741 req_id = abc0f8c9-0f63-4418-8265-52c6fccc2c78 roles = RoleSet { roles: {} } uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
79802025-03-25T22:06:43.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38741 req_id = abc0f8c9-0f63-4418-8265-52c6fccc2c78 resource = Database result = Ok(()) uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
79812025-03-25T22:06:43.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3082 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38741 req_id = abc0f8c9-0f63-4418-8265-52c6fccc2c78 response_code = 200 uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
79822025-03-25T22:06:43.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38741 req_id = dfa299e5-a34e-4c22-ada4-8e815a3d5266 roles = RoleSet { roles: {} } uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
79832025-03-25T22:06:43.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38741 req_id = dfa299e5-a34e-4c22-ada4-8e815a3d5266 resource = Database result = Ok(()) uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
79842025-03-25T22:06:43.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2337 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38741 req_id = dfa299e5-a34e-4c22-ada4-8e815a3d5266 response_code = 200 uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
79852025-03-25T22:06:43.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3d014942-6ae9-4ec2-8ad4-0a327048f95d roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79862025-03-25T22:06:43.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3d014942-6ae9-4ec2-8ad4-0a327048f95d resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79872025-03-25T22:06:43.800ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2220 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3d014942-6ae9-4ec2-8ad4-0a327048f95d response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79882025-03-25T22:06:44.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 13ed0979-3b32-4de9-960b-9577a5edfe33 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79892025-03-25T22:06:44.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 13ed0979-3b32-4de9-960b-9577a5edfe33 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79902025-03-25T22:06:44.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2057 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 13ed0979-3b32-4de9-960b-9577a5edfe33 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79912025-03-25T22:06:45.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3f50ab88-fed5-4f94-aa45-0d04113fd7dc roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79922025-03-25T22:06:45.843ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3f50ab88-fed5-4f94-aa45-0d04113fd7dc resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79932025-03-25T22:06:45.845ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2421 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3f50ab88-fed5-4f94-aa45-0d04113fd7dc response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79942025-03-25T22:06:46.866ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1bf743a8-ba83-4ee8-9908-39d8be2111df roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79952025-03-25T22:06:46.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1bf743a8-ba83-4ee8-9908-39d8be2111df resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79962025-03-25T22:06:46.868ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1951 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1bf743a8-ba83-4ee8-9908-39d8be2111df response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79972025-03-25T22:06:47.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c4a237e4-b651-4d86-8d60-94de827912fc roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79982025-03-25T22:06:47.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c4a237e4-b651-4d86-8d60-94de827912fc resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
79992025-03-25T22:06:47.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1875 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c4a237e4-b651-4d86-8d60-94de827912fc response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
80002025-03-25T22:06:48.573ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 549 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = 7c4b39ae-9a14-4719-ae31-17f9c442d108 response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
80012025-03-25T22:06:48.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ea6439e1-fed0-4281-9d5a-2e66271c562a roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
80022025-03-25T22:06:48.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ea6439e1-fed0-4281-9d5a-2e66271c562a resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
80032025-03-25T22:06:48.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2005 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ea6439e1-fed0-4281-9d5a-2e66271c562a response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
80042025-03-25T22:06:49.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6ee4a144-c678-4fc4-b63b-4239d46e5557 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
80052025-03-25T22:06:49.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6ee4a144-c678-4fc4-b63b-4239d46e5557 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
80062025-03-25T22:06:49.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2237 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6ee4a144-c678-4fc4-b63b-4239d46e5557 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
80072025-03-25T22:06:50.843ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
80082025-03-25T22:06:50.843ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
80092025-03-25T22:06:50.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
80102025-03-25T22:06:50.843ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
80112025-03-25T22:06:50.843ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
80122025-03-25T22:06:50.843ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80132025-03-25T22:06:50.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80142025-03-25T22:06:50.843ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
80152025-03-25T22:06:50.843ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
80162025-03-25T22:06:50.843ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80172025-03-25T22:06:50.843ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80182025-03-25T22:06:50.843ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
80192025-03-25T22:06:50.843ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 14 reason = Timeout
80202025-03-25T22:06:50.843ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
80212025-03-25T22:06:50.843ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
80222025-03-25T22:06:50.843ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
80232025-03-25T22:06:50.843ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80242025-03-25T22:06:50.843ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
80252025-03-25T22:06:50.844ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
80262025-03-25T22:06:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
80272025-03-25T22:06:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80282025-03-25T22:06:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80292025-03-25T22:06:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80302025-03-25T22:06:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
80312025-03-25T22:06:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80322025-03-25T22:06:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80332025-03-25T22:06:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
80342025-03-25T22:06:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
80352025-03-25T22:06:50.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
80362025-03-25T22:06:50.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80372025-03-25T22:06:50.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
80382025-03-25T22:06:50.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
80392025-03-25T22:06:50.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
80402025-03-25T22:06:50.844ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
80412025-03-25T22:06:50.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
80422025-03-25T22:06:50.844ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
80432025-03-25T22:06:50.844ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80442025-03-25T22:06:50.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
80452025-03-25T22:06:50.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
80462025-03-25T22:06:50.844ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 14 reason = Timeout
80472025-03-25T22:06:50.844ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
80482025-03-25T22:06:50.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
80492025-03-25T22:06:50.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
80502025-03-25T22:06:50.844ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
80512025-03-25T22:06:50.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
80522025-03-25T22:06:50.844ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
80532025-03-25T22:06:50.844ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
80542025-03-25T22:06:50.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
80552025-03-25T22:06:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
80562025-03-25T22:06:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
80572025-03-25T22:06:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80582025-03-25T22:06:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
80592025-03-25T22:06:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
80602025-03-25T22:06:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80612025-03-25T22:06:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
80622025-03-25T22:06:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
80632025-03-25T22:06:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
80642025-03-25T22:06:50.846ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80652025-03-25T22:06:50.846ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80662025-03-25T22:06:50.846ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6564, tv_nsec: 182677689 } })
80672025-03-25T22:06:50.846ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.237617ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
80682025-03-25T22:06:50.846ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1171
80692025-03-25T22:06:50.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80702025-03-25T22:06:50.847ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80712025-03-25T22:06:50.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
80722025-03-25T22:06:50.849ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80732025-03-25T22:06:50.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80742025-03-25T22:06:50.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
80752025-03-25T22:06:50.850ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80762025-03-25T22:06:50.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80772025-03-25T22:06:50.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
80782025-03-25T22:06:50.850ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80792025-03-25T22:06:50.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
80802025-03-25T22:06:50.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80812025-03-25T22:06:50.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80822025-03-25T22:06:50.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80832025-03-25T22:06:50.852ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6564, tv_nsec: 188799356 } })
80842025-03-25T22:06:50.853ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1171
80852025-03-25T22:06:50.853ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.197053ms iteration = 14 status = {"errors":[],"finish_invoked_ok":[]}
80862025-03-25T22:06:50.853ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80872025-03-25T22:06:50.854ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80882025-03-25T22:06:50.855ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80892025-03-25T22:06:50.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80902025-03-25T22:06:50.855ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
80912025-03-25T22:06:50.855ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80922025-03-25T22:06:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80932025-03-25T22:06:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
80942025-03-25T22:06:50.856ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
80952025-03-25T22:06:50.856ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 11.714105ms iteration = 14 status = {"errors":[],"requests_created_ok":[]}
80962025-03-25T22:06:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
80972025-03-25T22:06:50.859ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80982025-03-25T22:06:50.859ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80992025-03-25T22:06:50.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81002025-03-25T22:06:50.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81012025-03-25T22:06:50.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81022025-03-25T22:06:50.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81032025-03-25T22:06:50.861ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6564, tv_nsec: 197153242 } })
81042025-03-25T22:06:50.861ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1171 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
81052025-03-25T22:06:50.892ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81062025-03-25T22:06:50.895ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
81072025-03-25T22:06:50.895ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
81082025-03-25T22:06:50.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
81092025-03-25T22:06:50.906ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81102025-03-25T22:06:50.907ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
81112025-03-25T22:06:50.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81122025-03-25T22:06:50.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
81132025-03-25T22:06:50.909ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81142025-03-25T22:06:50.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81152025-03-25T22:06:50.910ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
81162025-03-25T22:06:50.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
81172025-03-25T22:06:50.912ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81182025-03-25T22:06:50.912ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 68.992885ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
81192025-03-25T22:06:50.914ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 69.308901ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
81202025-03-25T22:06:50.914ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
81212025-03-25T22:06:50.914ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
81222025-03-25T22:06:50.914ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
81232025-03-25T22:06:50.914ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 69.401942ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
81242025-03-25T22:06:50.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
81252025-03-25T22:06:50.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f034aaf6-2037-4cb4-8409-3ab31c15cc28, lookup_type: ById(f034aaf6-2037-4cb4-8409-3ab31c15cc28) } result = Ok(())
81262025-03-25T22:06:50.915ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81272025-03-25T22:06:50.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81282025-03-25T22:06:50.921ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
81292025-03-25T22:06:50.921ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
81302025-03-25T22:06:50.921ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 76.504867ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
81312025-03-25T22:06:50.921ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81322025-03-25T22:06:50.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
81332025-03-25T22:06:50.922ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81342025-03-25T22:06:50.924ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
81352025-03-25T22:06:50.924ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81362025-03-25T22:06:50.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81372025-03-25T22:06:50.925ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
81382025-03-25T22:06:50.925ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81392025-03-25T22:06:50.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81402025-03-25T22:06:50.925ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 82.006362ms iteration = 14 status = 0
81412025-03-25T22:06:50.925ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81422025-03-25T22:06:50.928ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
81432025-03-25T22:06:50.928ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81442025-03-25T22:06:50.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81452025-03-25T22:06:50.935ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
81462025-03-25T22:06:50.935ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 91.727712ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
81472025-03-25T22:06:50.942ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
81482025-03-25T22:06:50.942ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
81492025-03-25T22:06:50.943ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "315bfe69-6514-492e-937b-cd7ebee93e62", "content-length": "26", "date": "Tue, 25 Mar 2025 22:06:49 GMT"} })
81502025-03-25T22:06:50.943ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
81512025-03-25T22:06:50.944ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
81522025-03-25T22:06:50.945ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
81532025-03-25T22:06:50.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
81542025-03-25T22:06:50.946ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81552025-03-25T22:06:50.948ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
81562025-03-25T22:06:50.948ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
81572025-03-25T22:06:50.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
81582025-03-25T22:06:50.949ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:360
81592025-03-25T22:06:50.949ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 106.173585ms iteration = 14 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
81602025-03-25T22:06:50.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 986f31b1-87e8-459f-8e40-d2061cf58cf2 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
81612025-03-25T22:06:50.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 986f31b1-87e8-459f-8e40-d2061cf58cf2 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
81622025-03-25T22:06:50.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2241 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 986f31b1-87e8-459f-8e40-d2061cf58cf2 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
81632025-03-25T22:06:50.958ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
81642025-03-25T22:06:50.958ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
81652025-03-25T22:06:50.958ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e79a798d-3bf8-4414-96df-8dfe8588adea", "content-length": "26", "date": "Tue, 25 Mar 2025 22:06:49 GMT"} })
81662025-03-25T22:06:50.958ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
81672025-03-25T22:06:50.961ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
81682025-03-25T22:06:50.962ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
81692025-03-25T22:06:50.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
81702025-03-25T22:06:50.964ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 zone_address = fd00:1122:3344:101::2
81712025-03-25T22:06:50.964ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
81722025-03-25T22:06:50.964ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8850ee58-cbcd-4e69-9970-342b70dbb0e6", "content-length": "26", "date": "Tue, 25 Mar 2025 22:06:50 GMT"} })
81732025-03-25T22:06:50.964ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1184 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
81742025-03-25T22:06:50.965ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
81752025-03-25T22:06:50.965ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
81762025-03-25T22:06:50.965ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
81772025-03-25T22:06:50.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
81782025-03-25T22:06:50.966ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 121.598934ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
81792025-03-25T22:06:50.966ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
81802025-03-25T22:06:50.988ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81812025-03-25T22:06:50.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81822025-03-25T22:06:51.000ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 155.264052ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
81832025-03-25T22:06:51.010ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
81842025-03-25T22:06:51.011ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
81852025-03-25T22:06:51.011ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 166.067701ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
81862025-03-25T22:06:51.017ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 173.806136ms iteration = 14 status = {}
81872025-03-25T22:06:51.017ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
81882025-03-25T22:06:51.018ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "9040fb6a-6266-4e95-93a0-b58a812552a4", "content-length": "1", "date": "Tue, 25 Mar 2025 22:06:50 GMT"} })
81892025-03-25T22:06:51.020ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
81902025-03-25T22:06:51.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
81912025-03-25T22:06:51.022ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 179.20508ms iteration = 14 status = null
81922025-03-25T22:06:51.055ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 212.099225ms iteration = 16 status = {"physical_disks_added":0}
81932025-03-25T22:06:51.067ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
81942025-03-25T22:06:51.067ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
81952025-03-25T22:06:51.067ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d12755f-8857-47bc-ae06-613bd4111e72", "content-length": "372", "date": "Tue, 25 Mar 2025 22:06:51 GMT"} })
81962025-03-25T22:06:51.068ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81972025-03-25T22:06:51.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81982025-03-25T22:06:51.109ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81992025-03-25T22:06:51.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82002025-03-25T22:06:51.113ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82012025-03-25T22:06:51.115ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
82022025-03-25T22:06:51.115ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82032025-03-25T22:06:51.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82042025-03-25T22:06:51.117ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82052025-03-25T22:06:51.121ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
82062025-03-25T22:06:51.121ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82072025-03-25T22:06:51.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82082025-03-25T22:06:51.132ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
82092025-03-25T22:06:51.132ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
82102025-03-25T22:06:51.132ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "db090d17-df9a-4c57-a53f-ce8aa9cc03ad", "date": "Tue, 25 Mar 2025 22:06:51 GMT"} })
82112025-03-25T22:06:51.132ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82122025-03-25T22:06:51.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82132025-03-25T22:06:51.135ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82142025-03-25T22:06:51.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82152025-03-25T22:06:51.139ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82162025-03-25T22:06:51.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82172025-03-25T22:06:51.143ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
82182025-03-25T22:06:51.143ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
82192025-03-25T22:06:51.143ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "cf06baf8-68fa-4f1b-83fe-b8af1ff6ba2b", "date": "Tue, 25 Mar 2025 22:06:51 GMT"} })
82202025-03-25T22:06:51.146ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 301.781301ms iteration = 14 status = {}
82212025-03-25T22:06:51.167ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82222025-03-25T22:06:51.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82232025-03-25T22:06:51.169ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a5db250-fa3f-4168-ab16-5c36568c22e2, rack_id: c7210e4b-5a81-4ec8-b8fe-816a9508dc74, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(6d5dda50-e3c4-4853-9bfa-a66b447ab351) } rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
82242025-03-25T22:06:51.169ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82252025-03-25T22:06:51.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82262025-03-25T22:06:51.178ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
82272025-03-25T22:06:51.178ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2cdd139d-c509-4a87-b862-2d2c2a454738", "content-length": "691", "date": "Tue, 25 Mar 2025 22:06:51 GMT"} })
82282025-03-25T22:06:51.178ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
82292025-03-25T22:06:51.178ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
82302025-03-25T22:06:51.178ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
82312025-03-25T22:06:51.182ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 338.390852ms iteration = 14 status = {}
82322025-03-25T22:06:51.196ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
82332025-03-25T22:06:51.196ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d1e53f8-7b74-4471-b42e-feb056ba981a", "content-length": "134", "date": "Tue, 25 Mar 2025 22:06:50 GMT"} })
82342025-03-25T22:06:51.196ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
82352025-03-25T22:06:51.196ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 6d5dda50-e3c4-4853-9bfa-a66b447ab351
82362025-03-25T22:06:51.196ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
82372025-03-25T22:06:51.196ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
82382025-03-25T22:06:51.196ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
82392025-03-25T22:06:51.196ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
82402025-03-25T22:06:51.196ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
82412025-03-25T22:06:51.196ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
82422025-03-25T22:06:51.197ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
82432025-03-25T22:06:51.197ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
82442025-03-25T22:06:51.197ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
82452025-03-25T22:06:51.197ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82462025-03-25T22:06:51.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82472025-03-25T22:06:51.198ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
82482025-03-25T22:06:51.198ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "70808ded-c01e-4dd4-8463-6b7db629fe97", "content-length": "2", "date": "Tue, 25 Mar 2025 22:06:50 GMT"} })
82492025-03-25T22:06:51.199ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
82502025-03-25T22:06:51.199ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "a512fa15-f60b-449f-a407-eca5e0f70af0", "content-length": "52", "date": "Tue, 25 Mar 2025 22:06:50 GMT"} })
82512025-03-25T22:06:51.199ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
82522025-03-25T22:06:51.199ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
82532025-03-25T22:06:51.298ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "36926f97-05f4-4ab6-854b-25d7593f4767", "date": "Tue, 25 Mar 2025 22:06:51 GMT"} })
82542025-03-25T22:06:51.298ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch = Switch0
82552025-03-25T22:06:51.298ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
82562025-03-25T22:06:51.386ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e1176a4-53f4-4685-b0e0-39a1de7088f0", "content-length": "682", "date": "Tue, 25 Mar 2025 22:06:51 GMT"} })
82572025-03-25T22:06:51.386ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82582025-03-25T22:06:51.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82592025-03-25T22:06:51.390ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82602025-03-25T22:06:51.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82612025-03-25T22:06:51.393ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82622025-03-25T22:06:51.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82632025-03-25T22:06:51.394ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82642025-03-25T22:06:51.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82652025-03-25T22:06:51.401ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 557.741023ms iteration = 14 status = {}
82662025-03-25T22:06:51.980ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = cd0f9b0b-d0f8-401f-b22b-d1c8620a5357 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
82672025-03-25T22:06:51.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = cd0f9b0b-d0f8-401f-b22b-d1c8620a5357 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
82682025-03-25T22:06:51.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2059 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = cd0f9b0b-d0f8-401f-b22b-d1c8620a5357 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
82692025-03-25T22:06:53.001ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 84140855-e499-4c13-ad3f-2fae96d4ce59 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
82702025-03-25T22:06:53.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 84140855-e499-4c13-ad3f-2fae96d4ce59 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
82712025-03-25T22:06:53.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2709 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 84140855-e499-4c13-ad3f-2fae96d4ce59 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
82722025-03-25T22:06:54.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 61bb7eaf-1bd4-4adc-927b-44f6654de3c5 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
82732025-03-25T22:06:54.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 61bb7eaf-1bd4-4adc-927b-44f6654de3c5 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
82742025-03-25T22:06:54.026ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2392 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 61bb7eaf-1bd4-4adc-927b-44f6654de3c5 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
82752025-03-25T22:06:55.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 03072fdc-9eff-4d27-a444-3885089b8e90 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
82762025-03-25T22:06:55.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 03072fdc-9eff-4d27-a444-3885089b8e90 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
82772025-03-25T22:06:55.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2403 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 03072fdc-9eff-4d27-a444-3885089b8e90 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
82782025-03-25T22:06:56.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 19ef1bd3-dbd7-48ef-9730-1b667e62540a roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
82792025-03-25T22:06:56.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 19ef1bd3-dbd7-48ef-9730-1b667e62540a resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
82802025-03-25T22:06:56.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1446 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 19ef1bd3-dbd7-48ef-9730-1b667e62540a response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
82812025-03-25T22:06:57.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2c27b941-7037-4089-9a4d-0ca07e60288a roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
82822025-03-25T22:06:57.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2c27b941-7037-4089-9a4d-0ca07e60288a resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
82832025-03-25T22:06:57.092ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2415 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2c27b941-7037-4089-9a4d-0ca07e60288a response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
82842025-03-25T22:06:58.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0bd95f81-3661-47ad-9eb8-53a7ee242fca roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
82852025-03-25T22:06:58.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0bd95f81-3661-47ad-9eb8-53a7ee242fca resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
82862025-03-25T22:06:58.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1798 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0bd95f81-3661-47ad-9eb8-53a7ee242fca response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
82872025-03-25T22:06:58.573ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 469 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = bcc09be1-8b8b-4aa9-81c3-6fdaf2d12b62 response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
82882025-03-25T22:06:59.134ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 622bf207-9e61-493a-91ee-f6e38f8d8aba roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
82892025-03-25T22:06:59.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 622bf207-9e61-493a-91ee-f6e38f8d8aba resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
82902025-03-25T22:06:59.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2176 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 622bf207-9e61-493a-91ee-f6e38f8d8aba response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
82912025-03-25T22:07:00.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c946b5ca-28a7-4735-8e69-08d9fec0f46f roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
82922025-03-25T22:07:00.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c946b5ca-28a7-4735-8e69-08d9fec0f46f resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
82932025-03-25T22:07:00.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2479 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c946b5ca-28a7-4735-8e69-08d9fec0f46f response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
82942025-03-25T22:07:00.844ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
82952025-03-25T22:07:00.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82962025-03-25T22:07:00.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82972025-03-25T22:07:00.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
82982025-03-25T22:07:00.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82992025-03-25T22:07:00.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83002025-03-25T22:07:00.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83012025-03-25T22:07:00.846ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83022025-03-25T22:07:00.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83032025-03-25T22:07:00.848ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.558222ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
83042025-03-25T22:07:00.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
83052025-03-25T22:07:00.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83062025-03-25T22:07:00.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83072025-03-25T22:07:00.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83082025-03-25T22:07:00.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83092025-03-25T22:07:00.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83102025-03-25T22:07:00.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
83112025-03-25T22:07:00.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83122025-03-25T22:07:00.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83132025-03-25T22:07:00.861ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
83142025-03-25T22:07:00.861ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.280081ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
83152025-03-25T22:07:01.177ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 205fa36e-f7ff-4d42-99bb-16bad6ccbe17 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83162025-03-25T22:07:01.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 205fa36e-f7ff-4d42-99bb-16bad6ccbe17 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83172025-03-25T22:07:01.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1930 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 205fa36e-f7ff-4d42-99bb-16bad6ccbe17 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83182025-03-25T22:07:02.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3b7246f3-50fa-471b-a6bf-1fcc06b49baa roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83192025-03-25T22:07:02.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3b7246f3-50fa-471b-a6bf-1fcc06b49baa resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83202025-03-25T22:07:02.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2482 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3b7246f3-50fa-471b-a6bf-1fcc06b49baa response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83212025-03-25T22:07:03.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0695d14e-4813-4fe7-92ac-789be056c140 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83222025-03-25T22:07:03.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0695d14e-4813-4fe7-92ac-789be056c140 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83232025-03-25T22:07:03.225ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2460 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0695d14e-4813-4fe7-92ac-789be056c140 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83242025-03-25T22:07:04.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 46e63691-149d-4048-9f2a-b75437425b41 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83252025-03-25T22:07:04.247ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 46e63691-149d-4048-9f2a-b75437425b41 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83262025-03-25T22:07:04.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2049 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 46e63691-149d-4048-9f2a-b75437425b41 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83272025-03-25T22:07:05.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 82b4fe57-2819-407b-86da-e627c369ba27 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83282025-03-25T22:07:05.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 82b4fe57-2819-407b-86da-e627c369ba27 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83292025-03-25T22:07:05.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1789 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 82b4fe57-2819-407b-86da-e627c369ba27 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83302025-03-25T22:07:06.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 70d5ec14-285a-4fdd-bb8f-88ecef0e40c6 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83312025-03-25T22:07:06.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 70d5ec14-285a-4fdd-bb8f-88ecef0e40c6 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83322025-03-25T22:07:06.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2269 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 70d5ec14-285a-4fdd-bb8f-88ecef0e40c6 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83332025-03-25T22:07:07.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4722fea3-861f-4937-ac2f-3488f4932926 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83342025-03-25T22:07:07.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4722fea3-861f-4937-ac2f-3488f4932926 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83352025-03-25T22:07:07.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2227 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4722fea3-861f-4937-ac2f-3488f4932926 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83362025-03-25T22:07:08.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1f5e55be-b672-468c-a342-a1d7824ca1c7 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83372025-03-25T22:07:08.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1f5e55be-b672-468c-a342-a1d7824ca1c7 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83382025-03-25T22:07:08.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2213 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1f5e55be-b672-468c-a342-a1d7824ca1c7 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83392025-03-25T22:07:08.573ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 554 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = 6fd256ac-ffc5-405f-90a1-c272ce9a087d response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
83402025-03-25T22:07:09.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 44ed3a88-50dc-4f73-85ba-e0a6211ec0b7 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83412025-03-25T22:07:09.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 44ed3a88-50dc-4f73-85ba-e0a6211ec0b7 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83422025-03-25T22:07:09.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1999 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 44ed3a88-50dc-4f73-85ba-e0a6211ec0b7 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83432025-03-25T22:07:10.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6078b7dc-d4b2-4251-9ce5-7b41a6a05790 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83442025-03-25T22:07:10.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6078b7dc-d4b2-4251-9ce5-7b41a6a05790 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83452025-03-25T22:07:10.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2070 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6078b7dc-d4b2-4251-9ce5-7b41a6a05790 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83462025-03-25T22:07:10.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
83472025-03-25T22:07:10.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83482025-03-25T22:07:10.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83492025-03-25T22:07:10.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
83502025-03-25T22:07:10.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83512025-03-25T22:07:10.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83522025-03-25T22:07:10.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83532025-03-25T22:07:10.846ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83542025-03-25T22:07:10.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83552025-03-25T22:07:10.848ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.176513ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
83562025-03-25T22:07:10.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
83572025-03-25T22:07:10.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83582025-03-25T22:07:10.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83592025-03-25T22:07:10.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83602025-03-25T22:07:10.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83612025-03-25T22:07:10.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83622025-03-25T22:07:10.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
83632025-03-25T22:07:10.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83642025-03-25T22:07:10.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83652025-03-25T22:07:10.861ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
83662025-03-25T22:07:10.861ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.187888ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
83672025-03-25T22:07:11.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e5a99d47-40cd-400e-938c-b39eecafb71a roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83682025-03-25T22:07:11.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e5a99d47-40cd-400e-938c-b39eecafb71a resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83692025-03-25T22:07:11.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2075 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e5a99d47-40cd-400e-938c-b39eecafb71a response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83702025-03-25T22:07:12.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 85abf3d6-c9b7-47b0-b050-f979454b7c15 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83712025-03-25T22:07:12.421ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 85abf3d6-c9b7-47b0-b050-f979454b7c15 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83722025-03-25T22:07:12.423ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2478 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 85abf3d6-c9b7-47b0-b050-f979454b7c15 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83732025-03-25T22:07:13.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 725232a9-5e98-43e0-afb8-64dc266e6de0 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83742025-03-25T22:07:13.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 725232a9-5e98-43e0-afb8-64dc266e6de0 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83752025-03-25T22:07:13.446ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1793 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 725232a9-5e98-43e0-afb8-64dc266e6de0 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83762025-03-25T22:07:13.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38741 req_id = 13692da8-a9d9-4f0c-aa0a-50d365026c3f roles = RoleSet { roles: {} } uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
83772025-03-25T22:07:13.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38741 req_id = 13692da8-a9d9-4f0c-aa0a-50d365026c3f resource = Database result = Ok(()) uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
83782025-03-25T22:07:13.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2965 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38741 req_id = 13692da8-a9d9-4f0c-aa0a-50d365026c3f response_code = 200 uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
83792025-03-25T22:07:13.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38741 req_id = 8de81268-2de3-4840-a437-e156c39971d0 roles = RoleSet { roles: {} } uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
83802025-03-25T22:07:13.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38741 req_id = 8de81268-2de3-4840-a437-e156c39971d0 resource = Database result = Ok(()) uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
83812025-03-25T22:07:13.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1913 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38741 req_id = 8de81268-2de3-4840-a437-e156c39971d0 response_code = 200 uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
83822025-03-25T22:07:14.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ad960f17-dbdb-4f58-9f0c-6cc77e224120 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83832025-03-25T22:07:14.467ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ad960f17-dbdb-4f58-9f0c-6cc77e224120 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83842025-03-25T22:07:14.469ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2355 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ad960f17-dbdb-4f58-9f0c-6cc77e224120 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83852025-03-25T22:07:15.489ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 57022121-7885-4968-a893-a393d7bbc332 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83862025-03-25T22:07:15.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 57022121-7885-4968-a893-a393d7bbc332 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83872025-03-25T22:07:15.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2651 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 57022121-7885-4968-a893-a393d7bbc332 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83882025-03-25T22:07:16.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 9b5bc83b-3bba-41a6-862d-e999265b36a1 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83892025-03-25T22:07:16.512ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 9b5bc83b-3bba-41a6-862d-e999265b36a1 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83902025-03-25T22:07:16.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2052 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 9b5bc83b-3bba-41a6-862d-e999265b36a1 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83912025-03-25T22:07:17.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b115f89c-c374-40c5-ab21-45c5526ce919 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83922025-03-25T22:07:17.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b115f89c-c374-40c5-ab21-45c5526ce919 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83932025-03-25T22:07:17.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1557 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b115f89c-c374-40c5-ab21-45c5526ce919 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83942025-03-25T22:07:18.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = bcb00477-47c9-44b3-82ea-0eeeb0c9700f roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83952025-03-25T22:07:18.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = bcb00477-47c9-44b3-82ea-0eeeb0c9700f resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83962025-03-25T22:07:18.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2112 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = bcb00477-47c9-44b3-82ea-0eeeb0c9700f response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83972025-03-25T22:07:18.573ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 573 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = 6fc53143-3da9-4068-aff4-b5ef378b901a response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
83982025-03-25T22:07:19.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0d971c7d-0f22-4f7f-9f8c-8c07f7d77571 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
83992025-03-25T22:07:19.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0d971c7d-0f22-4f7f-9f8c-8c07f7d77571 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
84002025-03-25T22:07:19.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2457 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0d971c7d-0f22-4f7f-9f8c-8c07f7d77571 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
84012025-03-25T22:07:20.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2df26b14-ae26-49a5-bc73-e8de83bec3cc roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
84022025-03-25T22:07:20.597ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2df26b14-ae26-49a5-bc73-e8de83bec3cc resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
84032025-03-25T22:07:20.599ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2346 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2df26b14-ae26-49a5-bc73-e8de83bec3cc response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
84042025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
84052025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
84062025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
84072025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
84082025-03-25T22:07:20.844ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-03-25 21:57:20.844037625 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
84092025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
84102025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 15 reason = Timeout
84112025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84122025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
84132025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
84142025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
84152025-03-25T22:07:20.844ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
84162025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
84172025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
84182025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
84192025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
84202025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
84212025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
84222025-03-25T22:07:20.844ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:82 reason = blueprint disabled target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7
84232025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.03\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7"}
84242025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
84252025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
84262025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
84272025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
84282025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
84292025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
84302025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
84312025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84322025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
84332025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84342025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
84352025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
84362025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
84372025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84382025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84392025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
84402025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
84412025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
84422025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
84432025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
84442025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
84452025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
84462025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
84472025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84482025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 15 reason = Timeout
84492025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
84502025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
84512025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
84522025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
84532025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
84542025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84552025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
84562025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
84572025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
84582025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
84592025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
84602025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
84612025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
84622025-03-25T22:07:20.844ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
84632025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84642025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
84652025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
84662025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
84672025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
84682025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
84692025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
84702025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
84712025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
84722025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
84732025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
84742025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84752025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
84762025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
84772025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84782025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84792025-03-25T22:07:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
84802025-03-25T22:07:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
84812025-03-25T22:07:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
84822025-03-25T22:07:20.845ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5533f428-2028-4269-b7b1-f15912c01133.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("66b022b6-2e12-413e-b4b7-56c4ad5bdd77.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f337d25b-c67a-4a32-89e1-e187aea97ed9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f337d25b-c67a-4a32-89e1-e187aea97ed9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 6594, tv_nsec: 181104132 } })
84832025-03-25T22:07:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84842025-03-25T22:07:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
84852025-03-25T22:07:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
84862025-03-25T22:07:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
84872025-03-25T22:07:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
84882025-03-25T22:07:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
84892025-03-25T22:07:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84902025-03-25T22:07:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84912025-03-25T22:07:20.845ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("58d382a7-99da-40a7-bc9f-2da7e9b156c1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d42076c6-06fe-4102-a978-c7d0a8dffb98.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d42076c6-06fe-4102-a978-c7d0a8dffb98.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 6594, tv_nsec: 181173243 } })
84922025-03-25T22:07:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
84932025-03-25T22:07:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84942025-03-25T22:07:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
84952025-03-25T22:07:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
84962025-03-25T22:07:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
84972025-03-25T22:07:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
84982025-03-25T22:07:20.845ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
84992025-03-25T22:07:20.845ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
85002025-03-25T22:07:20.845ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.573168ms iteration = 8 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
85012025-03-25T22:07:20.845ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.71151ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
85022025-03-25T22:07:20.845ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
85032025-03-25T22:07:20.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
85042025-03-25T22:07:20.846ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85052025-03-25T22:07:20.846ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.569845ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
85062025-03-25T22:07:20.847ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-03-25 21:57:20.844037625 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
85072025-03-25T22:07:20.847ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.472641ms iteration = 8 status = {"expiration":"2025-03-25T21:57:20.844037625Z","pruned":[]}
85082025-03-25T22:07:20.848ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85092025-03-25T22:07:20.848ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85102025-03-25T22:07:20.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
85112025-03-25T22:07:20.848ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
85122025-03-25T22:07:20.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
85132025-03-25T22:07:20.849ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
85142025-03-25T22:07:20.850ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
85152025-03-25T22:07:20.850ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
85162025-03-25T22:07:20.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
85172025-03-25T22:07:20.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
85182025-03-25T22:07:20.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
85192025-03-25T22:07:20.850ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85202025-03-25T22:07:20.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85212025-03-25T22:07:20.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85222025-03-25T22:07:20.852ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6594, tv_nsec: 188504771 } })
85232025-03-25T22:07:20.852ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1171
85242025-03-25T22:07:20.853ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 8.716183ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
85252025-03-25T22:07:20.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
85262025-03-25T22:07:20.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85272025-03-25T22:07:20.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85282025-03-25T22:07:20.856ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 11.517012ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
85292025-03-25T22:07:20.856ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
85302025-03-25T22:07:20.856ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
85312025-03-25T22:07:20.856ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
85322025-03-25T22:07:20.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
85332025-03-25T22:07:20.857ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85342025-03-25T22:07:20.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
85352025-03-25T22:07:20.859ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85362025-03-25T22:07:20.859ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85372025-03-25T22:07:20.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85382025-03-25T22:07:20.861ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6594, tv_nsec: 197372086 } })
85392025-03-25T22:07:20.861ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1171
85402025-03-25T22:07:20.861ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
85412025-03-25T22:07:20.861ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85422025-03-25T22:07:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85432025-03-25T22:07:20.862ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 18.444042ms iteration = 15 status = {"errors":[],"requests_created_ok":[]}
85442025-03-25T22:07:20.866ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85452025-03-25T22:07:20.868ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85462025-03-25T22:07:20.870ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
85472025-03-25T22:07:20.870ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
85482025-03-25T22:07:20.870ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 24.541989ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
85492025-03-25T22:07:20.870ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
85502025-03-25T22:07:20.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
85512025-03-25T22:07:20.871ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
85522025-03-25T22:07:20.871ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
85532025-03-25T22:07:20.871ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
85542025-03-25T22:07:20.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
85552025-03-25T22:07:20.874ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85562025-03-25T22:07:20.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85572025-03-25T22:07:20.875ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85582025-03-25T22:07:20.875ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85592025-03-25T22:07:20.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85602025-03-25T22:07:20.875ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
85612025-03-25T22:07:20.875ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6594, tv_nsec: 211668366 } })
85622025-03-25T22:07:20.875ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1171 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
85632025-03-25T22:07:20.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
85642025-03-25T22:07:20.877ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
85652025-03-25T22:07:20.877ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85662025-03-25T22:07:20.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85672025-03-25T22:07:20.882ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85682025-03-25T22:07:20.882ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85692025-03-25T22:07:20.884ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
85702025-03-25T22:07:20.884ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85712025-03-25T22:07:20.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85722025-03-25T22:07:20.885ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
85732025-03-25T22:07:20.885ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85742025-03-25T22:07:20.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85752025-03-25T22:07:20.894ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
85762025-03-25T22:07:20.894ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.079925ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
85772025-03-25T22:07:20.910ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
85782025-03-25T22:07:20.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
85792025-03-25T22:07:20.914ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85802025-03-25T22:07:20.916ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 71.242925ms iteration = 15 status = {"errors":[],"finish_invoked_ok":[]}
85812025-03-25T22:07:20.916ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85822025-03-25T22:07:20.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85832025-03-25T22:07:20.921ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
85842025-03-25T22:07:20.921ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
85852025-03-25T22:07:20.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
85862025-03-25T22:07:20.927ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 82.517842ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
85872025-03-25T22:07:20.930ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85882025-03-25T22:07:20.933ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
85892025-03-25T22:07:20.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
85902025-03-25T22:07:20.935ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
85912025-03-25T22:07:20.935ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85922025-03-25T22:07:20.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85932025-03-25T22:07:20.938ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
85942025-03-25T22:07:20.938ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
85952025-03-25T22:07:20.938ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
85962025-03-25T22:07:20.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
85972025-03-25T22:07:20.939ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85982025-03-25T22:07:20.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85992025-03-25T22:07:20.939ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86002025-03-25T22:07:20.941ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 97.524803ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
86012025-03-25T22:07:20.943ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
86022025-03-25T22:07:20.943ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
86032025-03-25T22:07:20.943ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
86042025-03-25T22:07:20.943ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
86052025-03-25T22:07:20.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
86062025-03-25T22:07:20.944ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
86072025-03-25T22:07:20.944ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86082025-03-25T22:07:20.947ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
86092025-03-25T22:07:20.947ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
86102025-03-25T22:07:20.947ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 103.02001ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
86112025-03-25T22:07:20.948ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
86122025-03-25T22:07:20.948ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
86132025-03-25T22:07:20.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
86142025-03-25T22:07:20.955ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
86152025-03-25T22:07:20.955ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 111.05932ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
86162025-03-25T22:07:20.958ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
86172025-03-25T22:07:20.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
86182025-03-25T22:07:20.974ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86192025-03-25T22:07:20.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86202025-03-25T22:07:20.983ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86212025-03-25T22:07:20.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86222025-03-25T22:07:20.990ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
86232025-03-25T22:07:20.990ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
86242025-03-25T22:07:20.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
86252025-03-25T22:07:20.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
86262025-03-25T22:07:20.993ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86272025-03-25T22:07:20.993ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 149.078454ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
86282025-03-25T22:07:20.995ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
86292025-03-25T22:07:20.995ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 150.604601ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
86302025-03-25T22:07:20.996ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
86312025-03-25T22:07:20.996ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
86322025-03-25T22:07:20.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
86332025-03-25T22:07:21.000ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
86342025-03-25T22:07:21.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
86352025-03-25T22:07:21.002ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
86362025-03-25T22:07:21.002ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
86372025-03-25T22:07:21.002ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 157.824307ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
86382025-03-25T22:07:21.002ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
86392025-03-25T22:07:21.002ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
86402025-03-25T22:07:21.002ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
86412025-03-25T22:07:21.002ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
86422025-03-25T22:07:21.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
86432025-03-25T22:07:21.003ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
86442025-03-25T22:07:21.003ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86452025-03-25T22:07:21.005ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86462025-03-25T22:07:21.006ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
86472025-03-25T22:07:21.006ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
86482025-03-25T22:07:21.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
86492025-03-25T22:07:21.009ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
86502025-03-25T22:07:21.010ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
86512025-03-25T22:07:21.010ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
86522025-03-25T22:07:21.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
86532025-03-25T22:07:21.011ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86542025-03-25T22:07:21.013ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 168.87596ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
86552025-03-25T22:07:21.015ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
86562025-03-25T22:07:21.015ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
86572025-03-25T22:07:21.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
86582025-03-25T22:07:21.016ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
86592025-03-25T22:07:21.016ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
86602025-03-25T22:07:21.016ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "61c46a65-98ee-465a-b5b6-e42aa0920415", "content-length": "26", "date": "Tue, 25 Mar 2025 22:07:21 GMT"} })
86612025-03-25T22:07:21.016ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
86622025-03-25T22:07:21.017ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
86632025-03-25T22:07:21.017ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 23d93905-7b89-4296-b050-7ff9ae235c15 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
86642025-03-25T22:07:21.017ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
86652025-03-25T22:07:21.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
86662025-03-25T22:07:21.018ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
86672025-03-25T22:07:21.034ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86682025-03-25T22:07:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f034aaf6-2037-4cb4-8409-3ab31c15cc28, lookup_type: ById(f034aaf6-2037-4cb4-8409-3ab31c15cc28) } result = Ok(())
86692025-03-25T22:07:21.037ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86702025-03-25T22:07:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86712025-03-25T22:07:21.044ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 200.163966ms iteration = 15 status = 0
86722025-03-25T22:07:21.045ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:360
86732025-03-25T22:07:21.045ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 201.811255ms iteration = 15 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
86742025-03-25T22:07:21.061ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-03-25T22:00:16.382271Z, time_modified: 2025-03-25T22:00:16.382271Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, db_silo: Silo { identity: SiloIdentity { id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-25T22:00:22.501108Z, time_modified: 2025-03-25T22:00:22.501108Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, db_silo: Silo { identity: SiloIdentity { id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-25T22:00:22.501108Z, time_modified: 2025-03-25T22:00:22.501108Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d" }] }) }
86752025-03-25T22:07:21.061ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 215.292431ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"5c35ff8c-21dd-48b9-9751-76bfa681bc38","tls_certs":["0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d"]}},"default_endpoint":{"silo_id":"5c35ff8c-21dd-48b9-9751-76bfa681bc38","tls_certs":["0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
86762025-03-25T22:07:21.062ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
86772025-03-25T22:07:21.062ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 96679ce4-e18c-487b-803a-7b26be55e85c dns_zone_name = oxide.test found_so_far = 0 version = 2
86782025-03-25T22:07:21.062ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
86792025-03-25T22:07:21.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
86802025-03-25T22:07:21.062ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86812025-03-25T22:07:21.064ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86822025-03-25T22:07:21.064ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86832025-03-25T22:07:21.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86842025-03-25T22:07:21.066ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
86852025-03-25T22:07:21.067ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
86862025-03-25T22:07:21.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
86872025-03-25T22:07:21.068ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
86882025-03-25T22:07:21.068ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
86892025-03-25T22:07:21.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
86902025-03-25T22:07:21.070ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 96679ce4-e18c-487b-803a-7b26be55e85c dns_zone_name = oxide.test found_so_far = 1 version = 2
86912025-03-25T22:07:21.070ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
86922025-03-25T22:07:21.070ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-03-25 22:00:22.561696 UTC dns_group = external generation = 2
86932025-03-25T22:07:21.070ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 226.798892ms iteration = 8 status = {"generation":2}
86942025-03-25T22:07:21.071ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 23d93905-7b89-4296-b050-7ff9ae235c15 dns_zone_name = control-plane.oxide.internal found_so_far = 52 version = 1
86952025-03-25T22:07:21.071ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
86962025-03-25T22:07:21.071ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-03-25 22:00:21.368103 UTC dns_group = internal generation = 1
86972025-03-25T22:07:21.071ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 227.503834ms iteration = 8 status = {"generation":1}
86982025-03-25T22:07:21.072ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 228.879838ms iteration = 17 status = {"physical_disks_added":0}
86992025-03-25T22:07:21.080ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87002025-03-25T22:07:21.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87012025-03-25T22:07:21.082ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87022025-03-25T22:07:21.085ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
87032025-03-25T22:07:21.085ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87042025-03-25T22:07:21.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87052025-03-25T22:07:21.091ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
87062025-03-25T22:07:21.091ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
87072025-03-25T22:07:21.091ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f6fb0d3f-b6b4-4061-9664-a4cc2e556672", "content-length": "26", "date": "Tue, 25 Mar 2025 22:07:21 GMT"} })
87082025-03-25T22:07:21.091ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
87092025-03-25T22:07:21.093ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
87102025-03-25T22:07:21.101ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87112025-03-25T22:07:21.101ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
87122025-03-25T22:07:21.101ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87132025-03-25T22:07:21.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87142025-03-25T22:07:21.174ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 zone_address = fd00:1122:3344:101::2
87152025-03-25T22:07:21.174ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
87162025-03-25T22:07:21.174ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "762eb0e3-b886-46c7-b54e-eef794da6c28", "content-length": "26", "date": "Tue, 25 Mar 2025 22:07:21 GMT"} })
87172025-03-25T22:07:21.174ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1184 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
87182025-03-25T22:07:21.175ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
87192025-03-25T22:07:21.179ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
87202025-03-25T22:07:21.181ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
87212025-03-25T22:07:21.182ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "91300baa-b2cb-4cb4-95ec-001db36ab2f9", "date": "Tue, 25 Mar 2025 22:07:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
87222025-03-25T22:07:21.182ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
87232025-03-25T22:07:21.183ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "1c555bf1-0cef-4ae8-a306-9ca45e2ace0c", "date": "Tue, 25 Mar 2025 22:07:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
87242025-03-25T22:07:21.183ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
87252025-03-25T22:07:21.185ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
87262025-03-25T22:07:21.185ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 341.037598ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
87272025-03-25T22:07:21.193ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
87282025-03-25T22:07:21.193ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc7da2c8-50a4-47c2-a1a8-e281e58e3896", "content-length": "1", "date": "Tue, 25 Mar 2025 22:07:20 GMT"} })
87292025-03-25T22:07:21.195ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
87302025-03-25T22:07:21.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
87312025-03-25T22:07:21.197ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 353.831901ms iteration = 15 status = null
87322025-03-25T22:07:21.204ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
87332025-03-25T22:07:21.204ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
87342025-03-25T22:07:21.205ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a8422a06-76f3-45c3-9343-55a83bc6d2e0", "content-length": "372", "date": "Tue, 25 Mar 2025 22:07:21 GMT"} })
87352025-03-25T22:07:21.205ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87362025-03-25T22:07:21.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87372025-03-25T22:07:21.217ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
87382025-03-25T22:07:21.217ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
87392025-03-25T22:07:21.217ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "8ac044b7-889a-436a-a5ba-ff89ddd156a4", "date": "Tue, 25 Mar 2025 22:07:21 GMT"} })
87402025-03-25T22:07:21.218ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87412025-03-25T22:07:21.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87422025-03-25T22:07:21.221ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87432025-03-25T22:07:21.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87442025-03-25T22:07:21.238ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 394.687605ms iteration = 15 status = {}
87452025-03-25T22:07:21.283ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
87462025-03-25T22:07:21.284ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "e596585c-e0a3-45ba-a02f-228dcb3e5cfe", "date": "Tue, 25 Mar 2025 22:07:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
87472025-03-25T22:07:21.284ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
87482025-03-25T22:07:21.286ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "4e9ef2ae-dc25-4f4a-af63-0891b3c9b968", "date": "Tue, 25 Mar 2025 22:07:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
87492025-03-25T22:07:21.286ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
87502025-03-25T22:07:21.287ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
87512025-03-25T22:07:21.288ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f90fd648-92c0-4edc-aae1-ca1f77d8e44b", "content-length": "691", "date": "Tue, 25 Mar 2025 22:07:21 GMT"} })
87522025-03-25T22:07:21.288ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
87532025-03-25T22:07:21.288ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
87542025-03-25T22:07:21.288ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
87552025-03-25T22:07:21.288ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "e5e571ea-0441-4261-8b21-8fb06ed50b97", "date": "Tue, 25 Mar 2025 22:07:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
87562025-03-25T22:07:21.288ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
87572025-03-25T22:07:21.289ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 445.37125ms iteration = 15 status = {}
87582025-03-25T22:07:21.290ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
87592025-03-25T22:07:21.290ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 446.054122ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
87602025-03-25T22:07:21.291ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87612025-03-25T22:07:21.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87622025-03-25T22:07:21.296ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
87632025-03-25T22:07:21.296ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
87642025-03-25T22:07:21.296ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d489609b-e6b0-42f1-8684-b246f16a3972", "date": "Tue, 25 Mar 2025 22:07:21 GMT"} })
87652025-03-25T22:07:21.298ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 454.108062ms iteration = 15 status = {}
87662025-03-25T22:07:21.360ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87672025-03-25T22:07:21.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87682025-03-25T22:07:21.363ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a5db250-fa3f-4168-ab16-5c36568c22e2, rack_id: c7210e4b-5a81-4ec8-b8fe-816a9508dc74, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(6d5dda50-e3c4-4853-9bfa-a66b447ab351) } rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
87692025-03-25T22:07:21.363ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87702025-03-25T22:07:21.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87712025-03-25T22:07:21.374ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
87722025-03-25T22:07:21.374ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "5c3c76ca-55bd-4084-ac6c-fc2ce8ef2187", "content-length": "134", "date": "Tue, 25 Mar 2025 22:07:20 GMT"} })
87732025-03-25T22:07:21.374ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
87742025-03-25T22:07:21.374ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 6d5dda50-e3c4-4853-9bfa-a66b447ab351
87752025-03-25T22:07:21.375ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
87762025-03-25T22:07:21.375ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
87772025-03-25T22:07:21.375ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
87782025-03-25T22:07:21.375ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
87792025-03-25T22:07:21.375ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
87802025-03-25T22:07:21.375ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
87812025-03-25T22:07:21.375ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
87822025-03-25T22:07:21.375ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
87832025-03-25T22:07:21.375ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
87842025-03-25T22:07:21.375ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87852025-03-25T22:07:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87862025-03-25T22:07:21.377ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
87872025-03-25T22:07:21.377ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4d05478-efb0-41a1-a09b-21163a5030e3", "content-length": "2", "date": "Tue, 25 Mar 2025 22:07:20 GMT"} })
87882025-03-25T22:07:21.378ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
87892025-03-25T22:07:21.378ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "139ac8d6-7f4b-4b7a-bc46-966f6049ba0b", "content-length": "52", "date": "Tue, 25 Mar 2025 22:07:20 GMT"} })
87902025-03-25T22:07:21.378ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
87912025-03-25T22:07:21.378ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
87922025-03-25T22:07:21.496ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9592b7ac-3056-47f1-b4e6-50c686e9323d", "date": "Tue, 25 Mar 2025 22:07:21 GMT"} })
87932025-03-25T22:07:21.496ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch = Switch0
87942025-03-25T22:07:21.496ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
87952025-03-25T22:07:21.497ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "92c12b92-8e35-463a-9324-a998077116de", "content-length": "682", "date": "Tue, 25 Mar 2025 22:07:21 GMT"} })
87962025-03-25T22:07:21.497ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87972025-03-25T22:07:21.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87982025-03-25T22:07:21.501ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87992025-03-25T22:07:21.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88002025-03-25T22:07:21.505ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88012025-03-25T22:07:21.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88022025-03-25T22:07:21.507ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88032025-03-25T22:07:21.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88042025-03-25T22:07:21.515ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 671.053532ms iteration = 15 status = {}
88052025-03-25T22:07:21.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d16932b3-b3b1-4e2c-aec8-b5e9aea93896 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88062025-03-25T22:07:21.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d16932b3-b3b1-4e2c-aec8-b5e9aea93896 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88072025-03-25T22:07:21.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2482 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d16932b3-b3b1-4e2c-aec8-b5e9aea93896 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88082025-03-25T22:07:22.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 885635d2-f89e-4578-adb9-68d7b1aaa520 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88092025-03-25T22:07:22.643ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 885635d2-f89e-4578-adb9-68d7b1aaa520 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88102025-03-25T22:07:22.644ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1964 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 885635d2-f89e-4578-adb9-68d7b1aaa520 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88112025-03-25T22:07:23.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 18bd058d-e060-4bef-ae33-5f1460203dba roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88122025-03-25T22:07:23.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 18bd058d-e060-4bef-ae33-5f1460203dba resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88132025-03-25T22:07:23.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2148 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 18bd058d-e060-4bef-ae33-5f1460203dba response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88142025-03-25T22:07:24.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4d27098a-10d6-4904-9b05-5f7cbda3b2a6 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88152025-03-25T22:07:24.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4d27098a-10d6-4904-9b05-5f7cbda3b2a6 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88162025-03-25T22:07:24.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2242 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4d27098a-10d6-4904-9b05-5f7cbda3b2a6 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88172025-03-25T22:07:25.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 75511d34-7eb0-45cb-bb81-846cf1b1a38f roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88182025-03-25T22:07:25.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 75511d34-7eb0-45cb-bb81-846cf1b1a38f resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88192025-03-25T22:07:25.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2168 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 75511d34-7eb0-45cb-bb81-846cf1b1a38f response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88202025-03-25T22:07:26.730ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2d5b98f1-97cd-4493-be6c-157e592eb189 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88212025-03-25T22:07:26.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2d5b98f1-97cd-4493-be6c-157e592eb189 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88222025-03-25T22:07:26.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2307 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2d5b98f1-97cd-4493-be6c-157e592eb189 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88232025-03-25T22:07:27.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = bc1a59f1-f950-4bf8-86b8-5ba793065b26 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88242025-03-25T22:07:27.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = bc1a59f1-f950-4bf8-86b8-5ba793065b26 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88252025-03-25T22:07:27.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1587 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = bc1a59f1-f950-4bf8-86b8-5ba793065b26 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88262025-03-25T22:07:28.572ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 495 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = 953920ea-570b-4557-8da8-3d5915ae5957 response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
88272025-03-25T22:07:28.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b48f27eb-a28e-42b6-af04-56e1032ba744 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88282025-03-25T22:07:28.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b48f27eb-a28e-42b6-af04-56e1032ba744 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88292025-03-25T22:07:28.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2199 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b48f27eb-a28e-42b6-af04-56e1032ba744 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88302025-03-25T22:07:29.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 047e6ce0-ed62-4589-b9cc-f27e320c4623 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88312025-03-25T22:07:29.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 047e6ce0-ed62-4589-b9cc-f27e320c4623 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88322025-03-25T22:07:29.800ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1960 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 047e6ce0-ed62-4589-b9cc-f27e320c4623 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88332025-03-25T22:07:30.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = bea1d8fc-f8c7-4381-b699-37c4adf6b113 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88342025-03-25T22:07:30.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = bea1d8fc-f8c7-4381-b699-37c4adf6b113 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88352025-03-25T22:07:30.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2131 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = bea1d8fc-f8c7-4381-b699-37c4adf6b113 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88362025-03-25T22:07:30.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
88372025-03-25T22:07:30.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88382025-03-25T22:07:30.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88392025-03-25T22:07:30.845ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
88402025-03-25T22:07:30.845ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88412025-03-25T22:07:30.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88422025-03-25T22:07:30.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88432025-03-25T22:07:30.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
88442025-03-25T22:07:30.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88452025-03-25T22:07:30.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88462025-03-25T22:07:30.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88472025-03-25T22:07:30.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88482025-03-25T22:07:30.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88492025-03-25T22:07:30.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
88502025-03-25T22:07:30.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88512025-03-25T22:07:30.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88522025-03-25T22:07:30.859ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
88532025-03-25T22:07:30.859ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.138472ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
88542025-03-25T22:07:30.878ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88552025-03-25T22:07:30.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88562025-03-25T22:07:30.914ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 69.888561ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
88572025-03-25T22:07:31.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 448c8c97-be19-494c-b593-d545405e4253 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88582025-03-25T22:07:31.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 448c8c97-be19-494c-b593-d545405e4253 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88592025-03-25T22:07:31.843ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1837 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 448c8c97-be19-494c-b593-d545405e4253 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88602025-03-25T22:07:32.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0c7d4fe8-86cc-4bd4-9c1a-6da39a38fe0c roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88612025-03-25T22:07:32.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0c7d4fe8-86cc-4bd4-9c1a-6da39a38fe0c resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88622025-03-25T22:07:32.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2715 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0c7d4fe8-86cc-4bd4-9c1a-6da39a38fe0c response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88632025-03-25T22:07:33.884ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 73fe5d84-3429-4ef2-ac24-60534fe7c33d roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88642025-03-25T22:07:33.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 73fe5d84-3429-4ef2-ac24-60534fe7c33d resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88652025-03-25T22:07:33.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2368 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 73fe5d84-3429-4ef2-ac24-60534fe7c33d response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88662025-03-25T22:07:34.906ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 887dbd90-6f48-45d6-866a-3de6a69851d7 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88672025-03-25T22:07:34.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 887dbd90-6f48-45d6-866a-3de6a69851d7 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88682025-03-25T22:07:34.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2230 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 887dbd90-6f48-45d6-866a-3de6a69851d7 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88692025-03-25T22:07:35.928ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d5114c19-0966-404b-8907-d754dc27ed47 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88702025-03-25T22:07:35.928ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d5114c19-0966-404b-8907-d754dc27ed47 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88712025-03-25T22:07:35.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2427 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d5114c19-0966-404b-8907-d754dc27ed47 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88722025-03-25T22:07:36.949ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = dfbccf6b-b86b-46f3-ac0f-971e61b92a29 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88732025-03-25T22:07:36.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = dfbccf6b-b86b-46f3-ac0f-971e61b92a29 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88742025-03-25T22:07:36.951ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1735 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = dfbccf6b-b86b-46f3-ac0f-971e61b92a29 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88752025-03-25T22:07:37.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 25cea327-b28b-4f89-b8b3-ca316cd29e84 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88762025-03-25T22:07:37.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 25cea327-b28b-4f89-b8b3-ca316cd29e84 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88772025-03-25T22:07:37.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2046 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 25cea327-b28b-4f89-b8b3-ca316cd29e84 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88782025-03-25T22:07:38.573ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 807 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = 79465418-28f6-4c2d-b877-4112305fe794 response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
88792025-03-25T22:07:38.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 31c4f424-5d43-48bb-8a70-713248c34af4 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88802025-03-25T22:07:38.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 31c4f424-5d43-48bb-8a70-713248c34af4 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88812025-03-25T22:07:38.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2210 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 31c4f424-5d43-48bb-8a70-713248c34af4 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88822025-03-25T22:07:40.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 268fa29d-ca68-438b-88f2-0589010981ce roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88832025-03-25T22:07:40.015ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 268fa29d-ca68-438b-88f2-0589010981ce resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88842025-03-25T22:07:40.017ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2177 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 268fa29d-ca68-438b-88f2-0589010981ce response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
88852025-03-25T22:07:40.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
88862025-03-25T22:07:40.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88872025-03-25T22:07:40.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88882025-03-25T22:07:40.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
88892025-03-25T22:07:40.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88902025-03-25T22:07:40.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88912025-03-25T22:07:40.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88922025-03-25T22:07:40.845ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88932025-03-25T22:07:40.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88942025-03-25T22:07:40.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
88952025-03-25T22:07:40.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88962025-03-25T22:07:40.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88972025-03-25T22:07:40.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88982025-03-25T22:07:40.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88992025-03-25T22:07:40.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89002025-03-25T22:07:40.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
89012025-03-25T22:07:40.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89022025-03-25T22:07:40.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89032025-03-25T22:07:40.862ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
89042025-03-25T22:07:40.862ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.405269ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
89052025-03-25T22:07:40.873ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.456935ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
89062025-03-25T22:07:41.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 926d1635-77e0-468c-b319-37b2695ee178 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
89072025-03-25T22:07:41.037ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 926d1635-77e0-468c-b319-37b2695ee178 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
89082025-03-25T22:07:41.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1314 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 926d1635-77e0-468c-b319-37b2695ee178 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
89092025-03-25T22:07:42.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d0e31ca2-43b8-46d0-acb2-327812181a96 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
89102025-03-25T22:07:42.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d0e31ca2-43b8-46d0-acb2-327812181a96 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
89112025-03-25T22:07:42.061ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2168 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d0e31ca2-43b8-46d0-acb2-327812181a96 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
89122025-03-25T22:07:43.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1f2f0fbe-1461-41a1-a3d3-6f5077039de8 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
89132025-03-25T22:07:43.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1f2f0fbe-1461-41a1-a3d3-6f5077039de8 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
89142025-03-25T22:07:43.083ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2787 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1f2f0fbe-1461-41a1-a3d3-6f5077039de8 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
89152025-03-25T22:07:43.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38741 req_id = ad4999f8-9f1e-4653-b422-8ed203bc0558 roles = RoleSet { roles: {} } uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
89162025-03-25T22:07:43.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38741 req_id = ad4999f8-9f1e-4653-b422-8ed203bc0558 resource = Database result = Ok(()) uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
89172025-03-25T22:07:43.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3119 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38741 req_id = ad4999f8-9f1e-4653-b422-8ed203bc0558 response_code = 200 uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
89182025-03-25T22:07:43.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38741 req_id = 7719b4fd-90b0-496b-ae01-551b5aba9159 roles = RoleSet { roles: {} } uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
89192025-03-25T22:07:43.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38741 req_id = 7719b4fd-90b0-496b-ae01-551b5aba9159 resource = Database result = Ok(()) uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
89202025-03-25T22:07:43.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2317 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38741 req_id = 7719b4fd-90b0-496b-ae01-551b5aba9159 response_code = 200 uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
89212025-03-25T22:07:44.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e88e58ea-474f-45b4-a633-b2dc72917249 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
89222025-03-25T22:07:44.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e88e58ea-474f-45b4-a633-b2dc72917249 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
89232025-03-25T22:07:44.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2259 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e88e58ea-474f-45b4-a633-b2dc72917249 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
89242025-03-25T22:07:45.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a3268010-d17d-43a5-8954-f930668afb83 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
89252025-03-25T22:07:45.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a3268010-d17d-43a5-8954-f930668afb83 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
89262025-03-25T22:07:45.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1858 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a3268010-d17d-43a5-8954-f930668afb83 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
89272025-03-25T22:07:46.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 290faa72-1f8c-4e55-929f-4f6c9cf7c28c roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
89282025-03-25T22:07:46.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 290faa72-1f8c-4e55-929f-4f6c9cf7c28c resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
89292025-03-25T22:07:46.151ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2371 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 290faa72-1f8c-4e55-929f-4f6c9cf7c28c response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
89302025-03-25T22:07:47.171ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 31e8cb9f-a8fb-4b61-86d5-401948aa7ad5 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
89312025-03-25T22:07:47.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 31e8cb9f-a8fb-4b61-86d5-401948aa7ad5 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
89322025-03-25T22:07:47.173ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2259 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 31e8cb9f-a8fb-4b61-86d5-401948aa7ad5 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
89332025-03-25T22:07:48.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ac83b6c6-1306-4aac-8f40-ab1af8ca1248 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
89342025-03-25T22:07:48.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ac83b6c6-1306-4aac-8f40-ab1af8ca1248 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
89352025-03-25T22:07:48.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2399 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ac83b6c6-1306-4aac-8f40-ab1af8ca1248 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
89362025-03-25T22:07:48.573ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 558 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = 2dc9a3f2-731b-422c-bccb-c3917baafc91 response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
89372025-03-25T22:07:49.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 83c6da43-173f-4b71-8a72-d51287e37ac0 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
89382025-03-25T22:07:49.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 83c6da43-173f-4b71-8a72-d51287e37ac0 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
89392025-03-25T22:07:49.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1732 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 83c6da43-173f-4b71-8a72-d51287e37ac0 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
89402025-03-25T22:07:50.235ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1b8a7960-103b-44f1-8c62-1154089ab77b roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
89412025-03-25T22:07:50.235ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1b8a7960-103b-44f1-8c62-1154089ab77b resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
89422025-03-25T22:07:50.237ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2037 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1b8a7960-103b-44f1-8c62-1154089ab77b response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
89432025-03-25T22:07:50.843ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 16 reason = Timeout
89442025-03-25T22:07:50.843ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
89452025-03-25T22:07:50.843ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
89462025-03-25T22:07:50.843ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
89472025-03-25T22:07:50.843ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89482025-03-25T22:07:50.843ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
89492025-03-25T22:07:50.844ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
89502025-03-25T22:07:50.844ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
89512025-03-25T22:07:50.844ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
89522025-03-25T22:07:50.844ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89532025-03-25T22:07:50.844ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89542025-03-25T22:07:50.844ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
89552025-03-25T22:07:50.844ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
89562025-03-25T22:07:50.844ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
89572025-03-25T22:07:50.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89582025-03-25T22:07:50.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
89592025-03-25T22:07:50.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
89602025-03-25T22:07:50.844ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
89612025-03-25T22:07:50.844ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89622025-03-25T22:07:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
89632025-03-25T22:07:50.844ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
89642025-03-25T22:07:50.844ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
89652025-03-25T22:07:50.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
89662025-03-25T22:07:50.844ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89672025-03-25T22:07:50.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
89682025-03-25T22:07:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
89692025-03-25T22:07:50.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
89702025-03-25T22:07:50.844ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
89712025-03-25T22:07:50.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
89722025-03-25T22:07:50.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
89732025-03-25T22:07:50.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
89742025-03-25T22:07:50.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
89752025-03-25T22:07:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89762025-03-25T22:07:50.844ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
89772025-03-25T22:07:50.844ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
89782025-03-25T22:07:50.844ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 16 reason = Timeout
89792025-03-25T22:07:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89802025-03-25T22:07:50.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
89812025-03-25T22:07:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89822025-03-25T22:07:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89832025-03-25T22:07:50.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
89842025-03-25T22:07:50.844ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
89852025-03-25T22:07:50.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
89862025-03-25T22:07:50.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89872025-03-25T22:07:50.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
89882025-03-25T22:07:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
89892025-03-25T22:07:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
89902025-03-25T22:07:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89912025-03-25T22:07:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
89922025-03-25T22:07:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
89932025-03-25T22:07:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
89942025-03-25T22:07:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89952025-03-25T22:07:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
89962025-03-25T22:07:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
89972025-03-25T22:07:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89982025-03-25T22:07:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
89992025-03-25T22:07:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
90002025-03-25T22:07:50.846ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90012025-03-25T22:07:50.847ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6624, tv_nsec: 183021065 } })
90022025-03-25T22:07:50.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90032025-03-25T22:07:50.847ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.293088ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
90042025-03-25T22:07:50.847ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1171
90052025-03-25T22:07:50.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
90062025-03-25T22:07:50.848ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
90072025-03-25T22:07:50.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
90082025-03-25T22:07:50.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
90092025-03-25T22:07:50.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90102025-03-25T22:07:50.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90112025-03-25T22:07:50.850ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90122025-03-25T22:07:50.850ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6624, tv_nsec: 186671399 } })
90132025-03-25T22:07:50.850ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1171
90142025-03-25T22:07:50.852ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90152025-03-25T22:07:50.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
90162025-03-25T22:07:50.852ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90172025-03-25T22:07:50.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90182025-03-25T22:07:50.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
90192025-03-25T22:07:50.854ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
90202025-03-25T22:07:50.854ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
90212025-03-25T22:07:50.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
90222025-03-25T22:07:50.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
90232025-03-25T22:07:50.854ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
90242025-03-25T22:07:50.854ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
90252025-03-25T22:07:50.854ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
90262025-03-25T22:07:50.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
90272025-03-25T22:07:50.855ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90282025-03-25T22:07:50.855ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
90292025-03-25T22:07:50.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
90302025-03-25T22:07:50.855ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90312025-03-25T22:07:50.856ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 11.778085ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
90322025-03-25T22:07:50.856ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90332025-03-25T22:07:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90342025-03-25T22:07:50.857ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 12.516129ms iteration = 16 status = {"errors":[],"finish_invoked_ok":[]}
90352025-03-25T22:07:50.857ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
90362025-03-25T22:07:50.857ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90372025-03-25T22:07:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90382025-03-25T22:07:50.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
90392025-03-25T22:07:50.858ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
90402025-03-25T22:07:50.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
90412025-03-25T22:07:50.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90422025-03-25T22:07:50.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90432025-03-25T22:07:50.860ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90442025-03-25T22:07:50.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90452025-03-25T22:07:50.861ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
90462025-03-25T22:07:50.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
90472025-03-25T22:07:50.861ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
90482025-03-25T22:07:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
90492025-03-25T22:07:50.862ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90502025-03-25T22:07:50.865ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
90512025-03-25T22:07:50.865ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90522025-03-25T22:07:50.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90532025-03-25T22:07:50.876ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 31.776175ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
90542025-03-25T22:07:50.895ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90552025-03-25T22:07:50.898ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
90562025-03-25T22:07:50.898ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90572025-03-25T22:07:50.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90582025-03-25T22:07:50.902ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6624, tv_nsec: 238152099 } })
90592025-03-25T22:07:50.902ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1171 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
90602025-03-25T22:07:50.911ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
90612025-03-25T22:07:50.911ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
90622025-03-25T22:07:50.911ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
90632025-03-25T22:07:50.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
90642025-03-25T22:07:50.915ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
90652025-03-25T22:07:50.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
90662025-03-25T22:07:50.918ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90672025-03-25T22:07:50.918ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 74.222726ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
90682025-03-25T22:07:50.919ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90692025-03-25T22:07:50.919ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90702025-03-25T22:07:50.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90712025-03-25T22:07:50.921ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
90722025-03-25T22:07:50.921ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
90732025-03-25T22:07:50.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
90742025-03-25T22:07:50.922ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
90752025-03-25T22:07:50.922ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90762025-03-25T22:07:50.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90772025-03-25T22:07:50.922ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90782025-03-25T22:07:50.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90792025-03-25T22:07:50.924ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90802025-03-25T22:07:50.925ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 81.323831ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
90812025-03-25T22:07:50.925ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
90822025-03-25T22:07:50.926ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
90832025-03-25T22:07:50.926ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 81.597716ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
90842025-03-25T22:07:50.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
90852025-03-25T22:07:50.927ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f034aaf6-2037-4cb4-8409-3ab31c15cc28, lookup_type: ById(f034aaf6-2037-4cb4-8409-3ab31c15cc28) } result = Ok(())
90862025-03-25T22:07:50.927ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90872025-03-25T22:07:50.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90882025-03-25T22:07:50.927ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 83.126202ms iteration = 16 status = {"errors":[],"requests_created_ok":[]}
90892025-03-25T22:07:50.929ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 85.85728ms iteration = 16 status = 0
90902025-03-25T22:07:50.934ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
90912025-03-25T22:07:50.934ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 90.717464ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
90922025-03-25T22:07:50.939ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90932025-03-25T22:07:50.943ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
90942025-03-25T22:07:50.943ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
90952025-03-25T22:07:50.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
90962025-03-25T22:07:50.966ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
90972025-03-25T22:07:50.966ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
90982025-03-25T22:07:50.966ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 122.047172ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
90992025-03-25T22:07:50.971ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:360
91002025-03-25T22:07:50.971ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 127.66012ms iteration = 16 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
91012025-03-25T22:07:50.976ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 132.049196ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
91022025-03-25T22:07:50.995ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 151.603198ms iteration = 18 status = {"physical_disks_added":0}
91032025-03-25T22:07:51.034ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
91042025-03-25T22:07:51.034ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
91052025-03-25T22:07:51.034ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "69230c0e-6e45-4eb1-be87-966d13d6c864", "content-length": "26", "date": "Tue, 25 Mar 2025 22:07:51 GMT"} })
91062025-03-25T22:07:51.034ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
91072025-03-25T22:07:51.036ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
91082025-03-25T22:07:51.088ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
91092025-03-25T22:07:51.088ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
91102025-03-25T22:07:51.088ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a8f472f-1f68-4f2f-aaf0-e4c817750357", "content-length": "372", "date": "Tue, 25 Mar 2025 22:07:51 GMT"} })
91112025-03-25T22:07:51.088ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91122025-03-25T22:07:51.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91132025-03-25T22:07:51.108ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
91142025-03-25T22:07:51.108ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
91152025-03-25T22:07:51.109ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e0a60349-1211-466b-8c0f-a9fbb90a1bbc", "content-length": "26", "date": "Tue, 25 Mar 2025 22:07:51 GMT"} })
91162025-03-25T22:07:51.109ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
91172025-03-25T22:07:51.111ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
91182025-03-25T22:07:51.123ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91192025-03-25T22:07:51.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91202025-03-25T22:07:51.126ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 zone_address = fd00:1122:3344:101::2
91212025-03-25T22:07:51.126ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
91222025-03-25T22:07:51.126ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "25db82e1-bc11-42a5-9b47-cd577123e587", "content-length": "26", "date": "Tue, 25 Mar 2025 22:07:51 GMT"} })
91232025-03-25T22:07:51.126ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1184 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
91242025-03-25T22:07:51.128ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
91252025-03-25T22:07:51.155ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 311.346078ms iteration = 16 status = {}
91262025-03-25T22:07:51.184ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91272025-03-25T22:07:51.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91282025-03-25T22:07:51.186ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91292025-03-25T22:07:51.186ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
91302025-03-25T22:07:51.187ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c3e927b-f7aa-4403-a6d7-2ab1dde9dfeb", "content-length": "1", "date": "Tue, 25 Mar 2025 22:07:50 GMT"} })
91312025-03-25T22:07:51.188ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
91322025-03-25T22:07:51.188ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
91332025-03-25T22:07:51.188ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
91342025-03-25T22:07:51.188ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91352025-03-25T22:07:51.189ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
91362025-03-25T22:07:51.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91372025-03-25T22:07:51.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
91382025-03-25T22:07:51.189ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "5e3c2df5-e5bf-45de-8f06-55656cffd0df", "date": "Tue, 25 Mar 2025 22:07:51 GMT"} })
91392025-03-25T22:07:51.189ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91402025-03-25T22:07:51.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91412025-03-25T22:07:51.192ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91422025-03-25T22:07:51.193ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 349.908913ms iteration = 16 status = null
91432025-03-25T22:07:51.194ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
91442025-03-25T22:07:51.194ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91452025-03-25T22:07:51.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91462025-03-25T22:07:51.196ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91472025-03-25T22:07:51.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91482025-03-25T22:07:51.200ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91492025-03-25T22:07:51.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91502025-03-25T22:07:51.203ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
91512025-03-25T22:07:51.203ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
91522025-03-25T22:07:51.203ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9bfeed7c-28e9-47b3-a9f2-6d0e5c744fb5", "date": "Tue, 25 Mar 2025 22:07:51 GMT"} })
91532025-03-25T22:07:51.205ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 360.944435ms iteration = 16 status = {}
91542025-03-25T22:07:51.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = fcf66f72-a191-4e71-a197-e039f6ed1fca roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
91552025-03-25T22:07:51.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = fcf66f72-a191-4e71-a197-e039f6ed1fca resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
91562025-03-25T22:07:51.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2774 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = fcf66f72-a191-4e71-a197-e039f6ed1fca response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
91572025-03-25T22:07:51.271ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
91582025-03-25T22:07:51.271ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f28d8950-4be4-45ab-875f-9527e31a82e7", "content-length": "691", "date": "Tue, 25 Mar 2025 22:07:51 GMT"} })
91592025-03-25T22:07:51.271ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
91602025-03-25T22:07:51.271ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
91612025-03-25T22:07:51.271ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
91622025-03-25T22:07:51.274ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 430.428698ms iteration = 16 status = {}
91632025-03-25T22:07:51.321ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91642025-03-25T22:07:51.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91652025-03-25T22:07:51.325ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a5db250-fa3f-4168-ab16-5c36568c22e2, rack_id: c7210e4b-5a81-4ec8-b8fe-816a9508dc74, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(6d5dda50-e3c4-4853-9bfa-a66b447ab351) } rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
91662025-03-25T22:07:51.325ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91672025-03-25T22:07:51.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91682025-03-25T22:07:51.340ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
91692025-03-25T22:07:51.340ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a48f150-c8ea-4d99-859e-5a1395f925c8", "content-length": "134", "date": "Tue, 25 Mar 2025 22:07:50 GMT"} })
91702025-03-25T22:07:51.340ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
91712025-03-25T22:07:51.340ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 6d5dda50-e3c4-4853-9bfa-a66b447ab351
91722025-03-25T22:07:51.341ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
91732025-03-25T22:07:51.341ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
91742025-03-25T22:07:51.341ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
91752025-03-25T22:07:51.341ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
91762025-03-25T22:07:51.341ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
91772025-03-25T22:07:51.341ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
91782025-03-25T22:07:51.341ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
91792025-03-25T22:07:51.341ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
91802025-03-25T22:07:51.341ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
91812025-03-25T22:07:51.341ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91822025-03-25T22:07:51.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91832025-03-25T22:07:51.344ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
91842025-03-25T22:07:51.344ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8db0b66d-82b8-4e3b-b24a-6937ca48aa36", "content-length": "2", "date": "Tue, 25 Mar 2025 22:07:50 GMT"} })
91852025-03-25T22:07:51.344ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
91862025-03-25T22:07:51.344ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "eeb62eea-2a74-4d7c-b791-4a42b4e9e7b8", "content-length": "52", "date": "Tue, 25 Mar 2025 22:07:50 GMT"} })
91872025-03-25T22:07:51.344ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
91882025-03-25T22:07:51.344ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
91892025-03-25T22:07:51.537ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e1b3671f-db0e-4891-8df6-6acd3c62cf26", "date": "Tue, 25 Mar 2025 22:07:51 GMT"} })
91902025-03-25T22:07:51.537ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch = Switch0
91912025-03-25T22:07:51.537ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
91922025-03-25T22:07:51.542ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f58a1d6-a0a9-47a7-a60f-a36bc62b56d4", "content-length": "682", "date": "Tue, 25 Mar 2025 22:07:51 GMT"} })
91932025-03-25T22:07:51.542ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91942025-03-25T22:07:51.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91952025-03-25T22:07:51.546ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91962025-03-25T22:07:51.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91972025-03-25T22:07:51.549ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91982025-03-25T22:07:51.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91992025-03-25T22:07:51.552ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92002025-03-25T22:07:51.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92012025-03-25T22:07:51.559ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 715.315745ms iteration = 16 status = {}
92022025-03-25T22:07:52.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = cab87842-2ee2-43d8-b1b1-30b3ff6cd11d roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92032025-03-25T22:07:52.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = cab87842-2ee2-43d8-b1b1-30b3ff6cd11d resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92042025-03-25T22:07:52.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1984 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = cab87842-2ee2-43d8-b1b1-30b3ff6cd11d response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92052025-03-25T22:07:53.306ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f44dabdb-00cc-48d9-a3b3-0aad654957d2 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92062025-03-25T22:07:53.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f44dabdb-00cc-48d9-a3b3-0aad654957d2 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92072025-03-25T22:07:53.308ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2173 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f44dabdb-00cc-48d9-a3b3-0aad654957d2 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92082025-03-25T22:07:54.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ea481fc2-ac85-4639-9b77-6c3a1e61b44c roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92092025-03-25T22:07:54.327ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ea481fc2-ac85-4639-9b77-6c3a1e61b44c resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92102025-03-25T22:07:54.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2009 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ea481fc2-ac85-4639-9b77-6c3a1e61b44c response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92112025-03-25T22:07:55.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = db2a973d-e3f2-4f41-98ed-c6c1201165da roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92122025-03-25T22:07:55.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = db2a973d-e3f2-4f41-98ed-c6c1201165da resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92132025-03-25T22:07:55.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1795 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = db2a973d-e3f2-4f41-98ed-c6c1201165da response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92142025-03-25T22:07:56.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8f7ad7d6-92aa-4696-9081-3cbb03753551 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92152025-03-25T22:07:56.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8f7ad7d6-92aa-4696-9081-3cbb03753551 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92162025-03-25T22:07:56.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2383 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8f7ad7d6-92aa-4696-9081-3cbb03753551 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92172025-03-25T22:07:57.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d51a7fba-9868-439c-817a-8d6eb1b9ef77 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92182025-03-25T22:07:57.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d51a7fba-9868-439c-817a-8d6eb1b9ef77 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92192025-03-25T22:07:57.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2299 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d51a7fba-9868-439c-817a-8d6eb1b9ef77 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92202025-03-25T22:07:58.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 64d37c68-5404-4e1b-b36f-e84e89118d97 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92212025-03-25T22:07:58.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 64d37c68-5404-4e1b-b36f-e84e89118d97 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92222025-03-25T22:07:58.419ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2039 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 64d37c68-5404-4e1b-b36f-e84e89118d97 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92232025-03-25T22:07:58.572ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 478 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = f8f10838-51da-43be-8d9d-ba4a7b0a486b response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
92242025-03-25T22:07:59.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 054e73f6-6098-41dc-ab53-61f859de993d roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92252025-03-25T22:07:59.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 054e73f6-6098-41dc-ab53-61f859de993d resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92262025-03-25T22:07:59.441ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2585 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 054e73f6-6098-41dc-ab53-61f859de993d response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92272025-03-25T22:08:00.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b23844dc-e277-4bb2-ab3e-8ff64bd2ac96 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92282025-03-25T22:08:00.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b23844dc-e277-4bb2-ab3e-8ff64bd2ac96 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92292025-03-25T22:08:00.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1935 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b23844dc-e277-4bb2-ab3e-8ff64bd2ac96 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92302025-03-25T22:08:00.844ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
92312025-03-25T22:08:00.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92322025-03-25T22:08:00.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92332025-03-25T22:08:00.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
92342025-03-25T22:08:00.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92352025-03-25T22:08:00.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92362025-03-25T22:08:00.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92372025-03-25T22:08:00.846ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92382025-03-25T22:08:00.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92392025-03-25T22:08:00.848ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.870198ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
92402025-03-25T22:08:00.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
92412025-03-25T22:08:00.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92422025-03-25T22:08:00.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92432025-03-25T22:08:00.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92442025-03-25T22:08:00.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92452025-03-25T22:08:00.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92462025-03-25T22:08:00.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
92472025-03-25T22:08:00.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92482025-03-25T22:08:00.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92492025-03-25T22:08:00.865ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
92502025-03-25T22:08:00.865ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.464035ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
92512025-03-25T22:08:01.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 226b80c0-720c-4465-b0d8-f21ff5fd6e6a roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92522025-03-25T22:08:01.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 226b80c0-720c-4465-b0d8-f21ff5fd6e6a resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92532025-03-25T22:08:01.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2245 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 226b80c0-720c-4465-b0d8-f21ff5fd6e6a response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92542025-03-25T22:08:02.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 029d2de3-4b33-4019-83de-19dc7d18b843 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92552025-03-25T22:08:02.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 029d2de3-4b33-4019-83de-19dc7d18b843 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92562025-03-25T22:08:02.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2205 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 029d2de3-4b33-4019-83de-19dc7d18b843 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92572025-03-25T22:08:03.533ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0fb490fa-5656-4ef6-83e1-05aa5231d437 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92582025-03-25T22:08:03.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0fb490fa-5656-4ef6-83e1-05aa5231d437 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92592025-03-25T22:08:03.536ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2374 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0fb490fa-5656-4ef6-83e1-05aa5231d437 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92602025-03-25T22:08:04.554ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8d610a10-98ea-4d99-9229-6144b05ec0f4 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92612025-03-25T22:08:04.554ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8d610a10-98ea-4d99-9229-6144b05ec0f4 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92622025-03-25T22:08:04.556ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1772 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8d610a10-98ea-4d99-9229-6144b05ec0f4 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92632025-03-25T22:08:05.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 00d7e0c8-0647-48d5-83c3-e77f9d9e07f0 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92642025-03-25T22:08:05.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 00d7e0c8-0647-48d5-83c3-e77f9d9e07f0 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92652025-03-25T22:08:05.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2886 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 00d7e0c8-0647-48d5-83c3-e77f9d9e07f0 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92662025-03-25T22:08:06.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 938c1df5-e9aa-46df-a69d-589f9eca5a61 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92672025-03-25T22:08:06.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 938c1df5-e9aa-46df-a69d-589f9eca5a61 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92682025-03-25T22:08:06.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2314 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 938c1df5-e9aa-46df-a69d-589f9eca5a61 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92692025-03-25T22:08:07.620ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c8e7b2f3-9e41-4e55-9301-214e1bddce7c roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92702025-03-25T22:08:07.620ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c8e7b2f3-9e41-4e55-9301-214e1bddce7c resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92712025-03-25T22:08:07.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2357 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c8e7b2f3-9e41-4e55-9301-214e1bddce7c response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92722025-03-25T22:08:08.573ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 566 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = 0f5ffef2-39ea-447e-8f9f-831ba6f70d4d response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
92732025-03-25T22:08:08.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f62ea777-8132-4ed0-bb53-d82d41517920 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92742025-03-25T22:08:08.642ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f62ea777-8132-4ed0-bb53-d82d41517920 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92752025-03-25T22:08:08.644ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1890 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f62ea777-8132-4ed0-bb53-d82d41517920 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92762025-03-25T22:08:09.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 834b40d1-970a-4ac9-8d09-268db69bb1f5 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92772025-03-25T22:08:09.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 834b40d1-970a-4ac9-8d09-268db69bb1f5 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92782025-03-25T22:08:09.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1808 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 834b40d1-970a-4ac9-8d09-268db69bb1f5 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92792025-03-25T22:08:10.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7c81d61c-82d0-470e-b34e-feb20e609ece roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92802025-03-25T22:08:10.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7c81d61c-82d0-470e-b34e-feb20e609ece resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92812025-03-25T22:08:10.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2451 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7c81d61c-82d0-470e-b34e-feb20e609ece response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
92822025-03-25T22:08:10.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
92832025-03-25T22:08:10.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92842025-03-25T22:08:10.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92852025-03-25T22:08:10.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92862025-03-25T22:08:10.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
92872025-03-25T22:08:10.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92882025-03-25T22:08:10.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92892025-03-25T22:08:10.846ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92902025-03-25T22:08:10.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92912025-03-25T22:08:10.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
92922025-03-25T22:08:10.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92932025-03-25T22:08:10.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92942025-03-25T22:08:10.848ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.594952ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
92952025-03-25T22:08:10.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92962025-03-25T22:08:10.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92972025-03-25T22:08:10.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92982025-03-25T22:08:10.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
92992025-03-25T22:08:10.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93002025-03-25T22:08:10.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93012025-03-25T22:08:10.863ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
93022025-03-25T22:08:10.863ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.370966ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
93032025-03-25T22:08:11.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 56b64130-24b3-4bf3-996f-d4309da26885 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
93042025-03-25T22:08:11.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 56b64130-24b3-4bf3-996f-d4309da26885 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
93052025-03-25T22:08:11.709ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2112 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 56b64130-24b3-4bf3-996f-d4309da26885 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
93062025-03-25T22:08:12.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 05914f6e-3c27-4242-affb-65d8283b7d78 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
93072025-03-25T22:08:12.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 05914f6e-3c27-4242-affb-65d8283b7d78 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
93082025-03-25T22:08:12.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2080 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 05914f6e-3c27-4242-affb-65d8283b7d78 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
93092025-03-25T22:08:13.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 33c2c197-f806-4543-9953-f7734dd0b04d roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
93102025-03-25T22:08:13.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 33c2c197-f806-4543-9953-f7734dd0b04d resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
93112025-03-25T22:08:13.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2085 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 33c2c197-f806-4543-9953-f7734dd0b04d response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
93122025-03-25T22:08:14.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c8e8d6c3-5bfc-4a41-8362-06f2deea5566 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
93132025-03-25T22:08:14.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c8e8d6c3-5bfc-4a41-8362-06f2deea5566 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
93142025-03-25T22:08:14.776ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2025 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c8e8d6c3-5bfc-4a41-8362-06f2deea5566 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
93152025-03-25T22:08:15.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 43e54bbf-a6ba-492d-808f-8b20f20876fd roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
93162025-03-25T22:08:15.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 43e54bbf-a6ba-492d-808f-8b20f20876fd resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
93172025-03-25T22:08:15.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2690 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 43e54bbf-a6ba-492d-808f-8b20f20876fd response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
93182025-03-25T22:08:16.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 98741351-d2da-478d-88a6-45780d75d457 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
93192025-03-25T22:08:16.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 98741351-d2da-478d-88a6-45780d75d457 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
93202025-03-25T22:08:16.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2188 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 98741351-d2da-478d-88a6-45780d75d457 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
93212025-03-25T22:08:17.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a78cce9b-34ee-4036-8248-9904a0dbee63 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
93222025-03-25T22:08:17.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a78cce9b-34ee-4036-8248-9904a0dbee63 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
93232025-03-25T22:08:17.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2358 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a78cce9b-34ee-4036-8248-9904a0dbee63 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
93242025-03-25T22:08:18.573ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 574 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = 94701221-b49c-4aeb-b3b6-400ef70187a1 response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
93252025-03-25T22:08:18.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b48a8b8a-a35b-454d-a693-3b23f1a85876 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
93262025-03-25T22:08:18.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b48a8b8a-a35b-454d-a693-3b23f1a85876 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
93272025-03-25T22:08:18.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1866 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b48a8b8a-a35b-454d-a693-3b23f1a85876 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
93282025-03-25T22:08:19.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3ead1d47-aa52-49bb-a3a3-2209299789e3 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
93292025-03-25T22:08:19.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3ead1d47-aa52-49bb-a3a3-2209299789e3 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
93302025-03-25T22:08:19.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2290 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3ead1d47-aa52-49bb-a3a3-2209299789e3 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
93312025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 17 reason = Timeout
93322025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
93332025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
93342025-03-25T22:08:20.844ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
93352025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
93362025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
93372025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
93382025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
93392025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
93402025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93412025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
93422025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
93432025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
93442025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
93452025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93462025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
93472025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93482025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
93492025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
93502025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
93512025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
93522025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93532025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
93542025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
93552025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
93562025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
93572025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
93582025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
93592025-03-25T22:08:20.844ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:82 reason = blueprint disabled target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7
93602025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 22.21\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7"}
93612025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
93622025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
93632025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
93642025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
93652025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93662025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
93672025-03-25T22:08:20.844ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-03-25 21:58:20.844399430 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
93682025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
93692025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
93702025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
93712025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
93722025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
93732025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
93742025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
93752025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
93762025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
93772025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
93782025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
93792025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
93802025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
93812025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
93822025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
93832025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
93842025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
93852025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
93862025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
93872025-03-25T22:08:20.844ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
93882025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
93892025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93902025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
93912025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
93922025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
93932025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
93942025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
93952025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 17 reason = Timeout
93962025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
93972025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
93982025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
93992025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94002025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
94012025-03-25T22:08:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94022025-03-25T22:08:20.844ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("58d382a7-99da-40a7-bc9f-2da7e9b156c1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d42076c6-06fe-4102-a978-c7d0a8dffb98.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d42076c6-06fe-4102-a978-c7d0a8dffb98.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 6654, tv_nsec: 180883508 } })
94032025-03-25T22:08:20.845ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5533f428-2028-4269-b7b1-f15912c01133.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("66b022b6-2e12-413e-b4b7-56c4ad5bdd77.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f337d25b-c67a-4a32-89e1-e187aea97ed9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f337d25b-c67a-4a32-89e1-e187aea97ed9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 6654, tv_nsec: 180944999 } })
94042025-03-25T22:08:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
94052025-03-25T22:08:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94062025-03-25T22:08:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
94072025-03-25T22:08:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
94082025-03-25T22:08:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
94092025-03-25T22:08:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
94102025-03-25T22:08:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
94112025-03-25T22:08:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94122025-03-25T22:08:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
94132025-03-25T22:08:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
94142025-03-25T22:08:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
94152025-03-25T22:08:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
94162025-03-25T22:08:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94172025-03-25T22:08:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94182025-03-25T22:08:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
94192025-03-25T22:08:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
94202025-03-25T22:08:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
94212025-03-25T22:08:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
94222025-03-25T22:08:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
94232025-03-25T22:08:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
94242025-03-25T22:08:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
94252025-03-25T22:08:20.845ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
94262025-03-25T22:08:20.845ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.15739ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
94272025-03-25T22:08:20.845ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
94282025-03-25T22:08:20.845ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.457945ms iteration = 9 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
94292025-03-25T22:08:20.846ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94302025-03-25T22:08:20.846ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
94312025-03-25T22:08:20.846ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94322025-03-25T22:08:20.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
94332025-03-25T22:08:20.847ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.990642ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
94342025-03-25T22:08:20.847ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94352025-03-25T22:08:20.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94362025-03-25T22:08:20.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
94372025-03-25T22:08:20.849ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
94382025-03-25T22:08:20.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
94392025-03-25T22:08:20.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
94402025-03-25T22:08:20.849ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
94412025-03-25T22:08:20.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
94422025-03-25T22:08:20.851ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
94432025-03-25T22:08:20.851ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94442025-03-25T22:08:20.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94452025-03-25T22:08:20.851ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
94462025-03-25T22:08:20.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94472025-03-25T22:08:20.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94482025-03-25T22:08:20.851ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6654, tv_nsec: 187750058 } })
94492025-03-25T22:08:20.851ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
94502025-03-25T22:08:20.852ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1171
94512025-03-25T22:08:20.852ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94522025-03-25T22:08:20.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
94532025-03-25T22:08:20.853ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94542025-03-25T22:08:20.854ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94552025-03-25T22:08:20.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
94562025-03-25T22:08:20.854ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94572025-03-25T22:08:20.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94582025-03-25T22:08:20.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
94592025-03-25T22:08:20.855ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
94602025-03-25T22:08:20.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
94612025-03-25T22:08:20.856ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
94622025-03-25T22:08:20.856ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
94632025-03-25T22:08:20.856ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
94642025-03-25T22:08:20.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
94652025-03-25T22:08:20.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
94662025-03-25T22:08:20.856ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 11.948349ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
94672025-03-25T22:08:20.857ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 13.249841ms iteration = 17 status = {"errors":[],"finish_invoked_ok":[]}
94682025-03-25T22:08:20.857ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-03-25 21:58:20.844399430 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
94692025-03-25T22:08:20.858ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 13.535746ms iteration = 9 status = {"expiration":"2025-03-25T21:58:20.844399430Z","pruned":[]}
94702025-03-25T22:08:20.858ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6654, tv_nsec: 194368194 } })
94712025-03-25T22:08:20.858ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1171
94722025-03-25T22:08:20.859ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94732025-03-25T22:08:20.860ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94742025-03-25T22:08:20.861ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
94752025-03-25T22:08:20.861ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94762025-03-25T22:08:20.861ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 16.978817ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
94772025-03-25T22:08:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94782025-03-25T22:08:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
94792025-03-25T22:08:20.863ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
94802025-03-25T22:08:20.863ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
94812025-03-25T22:08:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
94822025-03-25T22:08:20.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
94832025-03-25T22:08:20.864ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94842025-03-25T22:08:20.866ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94852025-03-25T22:08:20.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94862025-03-25T22:08:20.867ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94872025-03-25T22:08:20.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94882025-03-25T22:08:20.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
94892025-03-25T22:08:20.869ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94902025-03-25T22:08:20.871ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6654, tv_nsec: 206915893 } })
94912025-03-25T22:08:20.871ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1171 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
94922025-03-25T22:08:20.871ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94932025-03-25T22:08:20.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
94942025-03-25T22:08:20.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94952025-03-25T22:08:20.874ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
94962025-03-25T22:08:20.874ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
94972025-03-25T22:08:20.874ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
94982025-03-25T22:08:20.874ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
94992025-03-25T22:08:20.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
95002025-03-25T22:08:20.876ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
95012025-03-25T22:08:20.876ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95022025-03-25T22:08:20.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
95032025-03-25T22:08:20.878ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
95042025-03-25T22:08:20.878ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95052025-03-25T22:08:20.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95062025-03-25T22:08:20.880ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95072025-03-25T22:08:20.881ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 37.142809ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
95082025-03-25T22:08:20.882ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
95092025-03-25T22:08:20.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
95102025-03-25T22:08:20.884ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
95112025-03-25T22:08:20.884ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95122025-03-25T22:08:20.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95132025-03-25T22:08:20.887ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95142025-03-25T22:08:20.888ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95152025-03-25T22:08:20.891ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
95162025-03-25T22:08:20.891ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
95172025-03-25T22:08:20.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
95182025-03-25T22:08:20.892ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
95192025-03-25T22:08:20.892ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
95202025-03-25T22:08:20.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
95212025-03-25T22:08:20.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8547fcd7-17ce-4b46-b244-1022632643f5 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
95222025-03-25T22:08:20.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8547fcd7-17ce-4b46-b244-1022632643f5 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
95232025-03-25T22:08:20.909ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95242025-03-25T22:08:20.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95252025-03-25T22:08:20.916ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
95262025-03-25T22:08:20.916ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 72.513126ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
95272025-03-25T22:08:20.919ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
95282025-03-25T22:08:20.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
95292025-03-25T22:08:20.920ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95302025-03-25T22:08:20.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95312025-03-25T22:08:20.923ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 78.849917ms iteration = 17 status = {"errors":[],"requests_created_ok":[]}
95322025-03-25T22:08:20.924ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
95332025-03-25T22:08:20.924ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
95342025-03-25T22:08:20.924ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
95352025-03-25T22:08:20.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
95362025-03-25T22:08:20.925ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
95372025-03-25T22:08:20.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
95382025-03-25T22:08:20.930ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
95392025-03-25T22:08:20.930ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
95402025-03-25T22:08:20.930ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 85.966192ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
95412025-03-25T22:08:20.934ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 89.694457ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
95422025-03-25T22:08:20.936ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
95432025-03-25T22:08:20.936ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
95442025-03-25T22:08:20.936ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 92.092319ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
95452025-03-25T22:08:20.940ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
95462025-03-25T22:08:20.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
95472025-03-25T22:08:20.945ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
95482025-03-25T22:08:20.945ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
95492025-03-25T22:08:20.945ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
95502025-03-25T22:08:20.945ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
95512025-03-25T22:08:20.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
95522025-03-25T22:08:20.947ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
95532025-03-25T22:08:20.947ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 102.808606ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
95542025-03-25T22:08:20.949ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95552025-03-25T22:08:20.954ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
95562025-03-25T22:08:20.954ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
95572025-03-25T22:08:20.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
95582025-03-25T22:08:20.963ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
95592025-03-25T22:08:20.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
95602025-03-25T22:08:20.986ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
95612025-03-25T22:08:21.013ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
95622025-03-25T22:08:21.032ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 188.590615ms iteration = 19 status = {"physical_disks_added":0}
95632025-03-25T22:08:21.055ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
95642025-03-25T22:08:21.055ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
95652025-03-25T22:08:21.055ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8688ed5c-9da5-4f11-a88f-db3fc7f22d83", "content-length": "26", "date": "Tue, 25 Mar 2025 22:08:20 GMT"} })
95662025-03-25T22:08:21.055ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
95672025-03-25T22:08:21.056ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 zone_address = fd00:1122:3344:101::2
95682025-03-25T22:08:21.056ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
95692025-03-25T22:08:21.056ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5e03a88-c167-40d9-9f41-2346daf833b3", "content-length": "26", "date": "Tue, 25 Mar 2025 22:08:20 GMT"} })
95702025-03-25T22:08:21.056ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1184 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
95712025-03-25T22:08:21.058ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
95722025-03-25T22:08:21.058ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
95732025-03-25T22:08:21.116ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
95742025-03-25T22:08:21.116ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
95752025-03-25T22:08:21.116ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d294fdb8-6ab4-468f-b521-81717a0e8dde", "content-length": "26", "date": "Tue, 25 Mar 2025 22:08:20 GMT"} })
95762025-03-25T22:08:21.116ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
95772025-03-25T22:08:21.118ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
95782025-03-25T22:08:21.199ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
95792025-03-25T22:08:21.199ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
95802025-03-25T22:08:21.199ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "adacd1a6-2823-40a1-8272-ffe1d9d9a3a3", "content-length": "372", "date": "Tue, 25 Mar 2025 22:08:21 GMT"} })
95812025-03-25T22:08:21.199ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95822025-03-25T22:08:21.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95832025-03-25T22:08:21.201ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
95842025-03-25T22:08:21.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
95852025-03-25T22:08:21.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 294722 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8547fcd7-17ce-4b46-b244-1022632643f5 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
95862025-03-25T22:08:21.202ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95872025-03-25T22:08:21.205ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
95882025-03-25T22:08:21.205ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95892025-03-25T22:08:21.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95902025-03-25T22:08:21.207ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
95912025-03-25T22:08:21.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
95922025-03-25T22:08:21.212ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95932025-03-25T22:08:21.214ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
95942025-03-25T22:08:21.214ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95952025-03-25T22:08:21.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95962025-03-25T22:08:21.224ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
95972025-03-25T22:08:21.225ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "2b1b6c03-2701-493e-bae6-fd485e4190e7", "date": "Tue, 25 Mar 2025 22:08:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
95982025-03-25T22:08:21.225ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
95992025-03-25T22:08:21.227ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "dd676feb-11fb-4ee5-b8cb-103339346057", "date": "Tue, 25 Mar 2025 22:08:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
96002025-03-25T22:08:21.227ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
96012025-03-25T22:08:21.232ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
96022025-03-25T22:08:21.232ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 387.724963ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
96032025-03-25T22:08:21.254ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
96042025-03-25T22:08:21.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
96052025-03-25T22:08:21.258ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 413.699747ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
96062025-03-25T22:08:21.259ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96072025-03-25T22:08:21.259ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
96082025-03-25T22:08:21.259ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 23d93905-7b89-4296-b050-7ff9ae235c15 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
96092025-03-25T22:08:21.259ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
96102025-03-25T22:08:21.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
96112025-03-25T22:08:21.260ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96122025-03-25T22:08:21.262ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96132025-03-25T22:08:21.262ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96142025-03-25T22:08:21.263ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
96152025-03-25T22:08:21.263ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
96162025-03-25T22:08:21.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
96172025-03-25T22:08:21.265ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f034aaf6-2037-4cb4-8409-3ab31c15cc28, lookup_type: ById(f034aaf6-2037-4cb4-8409-3ab31c15cc28) } result = Ok(())
96182025-03-25T22:08:21.265ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
96192025-03-25T22:08:21.265ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
96202025-03-25T22:08:21.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
96212025-03-25T22:08:21.265ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
96222025-03-25T22:08:21.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
96232025-03-25T22:08:21.266ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
96242025-03-25T22:08:21.266ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
96252025-03-25T22:08:21.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
96262025-03-25T22:08:21.266ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
96272025-03-25T22:08:21.266ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
96282025-03-25T22:08:21.266ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
96292025-03-25T22:08:21.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
96302025-03-25T22:08:21.284ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
96312025-03-25T22:08:21.284ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
96322025-03-25T22:08:21.285ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "35f50732-1d64-4357-a787-41a03797ad18", "date": "Tue, 25 Mar 2025 22:08:21 GMT"} })
96332025-03-25T22:08:21.285ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96342025-03-25T22:08:21.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
96352025-03-25T22:08:21.294ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 450.343717ms iteration = 17 status = {}
96362025-03-25T22:08:21.295ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96372025-03-25T22:08:21.296ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 451.514887ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
96382025-03-25T22:08:21.299ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
96392025-03-25T22:08:21.299ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
96402025-03-25T22:08:21.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
96412025-03-25T22:08:21.302ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
96422025-03-25T22:08:21.305ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
96432025-03-25T22:08:21.305ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 461.459841ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
96442025-03-25T22:08:21.345ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
96452025-03-25T22:08:21.345ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "9dc97cd2-ccaf-4b34-a23f-a0ecd1eeaa06", "content-length": "1", "date": "Tue, 25 Mar 2025 22:08:20 GMT"} })
96462025-03-25T22:08:21.347ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
96472025-03-25T22:08:21.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
96482025-03-25T22:08:21.356ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
96492025-03-25T22:08:21.356ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "8481900a-3c84-4e73-a11b-534a2c06a021", "content-length": "691", "date": "Tue, 25 Mar 2025 22:08:21 GMT"} })
96502025-03-25T22:08:21.356ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
96512025-03-25T22:08:21.356ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
96522025-03-25T22:08:21.356ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
96532025-03-25T22:08:21.357ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 513.800275ms iteration = 17 status = {}
96542025-03-25T22:08:21.359ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 515.020056ms iteration = 17 status = 0
96552025-03-25T22:08:21.361ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96562025-03-25T22:08:21.362ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 517.839525ms iteration = 17 status = null
96572025-03-25T22:08:21.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
96582025-03-25T22:08:21.362ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 23d93905-7b89-4296-b050-7ff9ae235c15 dns_zone_name = control-plane.oxide.internal found_so_far = 52 version = 1
96592025-03-25T22:08:21.362ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
96602025-03-25T22:08:21.362ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-03-25 22:00:21.368103 UTC dns_group = internal generation = 1
96612025-03-25T22:08:21.362ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 518.763302ms iteration = 9 status = {"generation":1}
96622025-03-25T22:08:21.369ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96632025-03-25T22:08:21.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
96642025-03-25T22:08:21.375ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
96652025-03-25T22:08:21.375ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
96662025-03-25T22:08:21.375ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8e76fd8c-0d0f-449b-88f2-c93650a5f992", "date": "Tue, 25 Mar 2025 22:08:21 GMT"} })
96672025-03-25T22:08:21.377ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 532.576693ms iteration = 17 status = {}
96682025-03-25T22:08:21.391ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:360
96692025-03-25T22:08:21.391ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 547.32064ms iteration = 17 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
96702025-03-25T22:08:21.392ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
96712025-03-25T22:08:21.392ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 96679ce4-e18c-487b-803a-7b26be55e85c dns_zone_name = oxide.test found_so_far = 0 version = 2
96722025-03-25T22:08:21.392ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
96732025-03-25T22:08:21.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
96742025-03-25T22:08:21.393ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
96752025-03-25T22:08:21.393ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
96762025-03-25T22:08:21.393ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 548.900068ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
96772025-03-25T22:08:21.394ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96782025-03-25T22:08:21.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
96792025-03-25T22:08:21.397ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
96802025-03-25T22:08:21.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
96812025-03-25T22:08:21.399ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 96679ce4-e18c-487b-803a-7b26be55e85c dns_zone_name = oxide.test found_so_far = 1 version = 2
96822025-03-25T22:08:21.399ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
96832025-03-25T22:08:21.399ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-03-25 22:00:22.561696 UTC dns_group = external generation = 2
96842025-03-25T22:08:21.399ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 555.441783ms iteration = 9 status = {"generation":2}
96852025-03-25T22:08:21.401ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
96862025-03-25T22:08:21.402ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "5fa15fb9-0f1d-457f-a90f-f75b3465f283", "date": "Tue, 25 Mar 2025 22:08:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
96872025-03-25T22:08:21.402ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
96882025-03-25T22:08:21.403ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-03-25T22:00:16.382271Z, time_modified: 2025-03-25T22:00:16.382271Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, db_silo: Silo { identity: SiloIdentity { id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-25T22:00:22.501108Z, time_modified: 2025-03-25T22:00:22.501108Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, db_silo: Silo { identity: SiloIdentity { id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-25T22:00:22.501108Z, time_modified: 2025-03-25T22:00:22.501108Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d" }] }) }
96892025-03-25T22:08:21.403ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 559.515254ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"5c35ff8c-21dd-48b9-9751-76bfa681bc38","tls_certs":["0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d"]}},"default_endpoint":{"silo_id":"5c35ff8c-21dd-48b9-9751-76bfa681bc38","tls_certs":["0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
96902025-03-25T22:08:21.404ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "752438ac-b1ed-4c53-8be5-4cfcf5dee2a3", "date": "Tue, 25 Mar 2025 22:08:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
96912025-03-25T22:08:21.404ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
96922025-03-25T22:08:21.406ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "23f099f5-fe43-4ce9-8fda-85b7fb129873", "date": "Tue, 25 Mar 2025 22:08:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
96932025-03-25T22:08:21.406ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
96942025-03-25T22:08:21.408ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
96952025-03-25T22:08:21.408ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 564.297508ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
96962025-03-25T22:08:21.429ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96972025-03-25T22:08:21.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96982025-03-25T22:08:21.430ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a5db250-fa3f-4168-ab16-5c36568c22e2, rack_id: c7210e4b-5a81-4ec8-b8fe-816a9508dc74, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(6d5dda50-e3c4-4853-9bfa-a66b447ab351) } rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
96992025-03-25T22:08:21.430ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97002025-03-25T22:08:21.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97012025-03-25T22:08:21.441ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
97022025-03-25T22:08:21.441ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e772713-c82a-40be-9240-0c12dc5ce9da", "content-length": "134", "date": "Tue, 25 Mar 2025 22:08:20 GMT"} })
97032025-03-25T22:08:21.441ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
97042025-03-25T22:08:21.441ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 6d5dda50-e3c4-4853-9bfa-a66b447ab351
97052025-03-25T22:08:21.442ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
97062025-03-25T22:08:21.442ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
97072025-03-25T22:08:21.442ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
97082025-03-25T22:08:21.442ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
97092025-03-25T22:08:21.442ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
97102025-03-25T22:08:21.442ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
97112025-03-25T22:08:21.442ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
97122025-03-25T22:08:21.442ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
97132025-03-25T22:08:21.442ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
97142025-03-25T22:08:21.442ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97152025-03-25T22:08:21.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97162025-03-25T22:08:21.443ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
97172025-03-25T22:08:21.444ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f2580792-d063-42b0-9bdf-3df9bd7ad9af", "content-length": "2", "date": "Tue, 25 Mar 2025 22:08:20 GMT"} })
97182025-03-25T22:08:21.444ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
97192025-03-25T22:08:21.444ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "38f78271-89ba-4c5e-a139-d1a5f46ba16c", "content-length": "52", "date": "Tue, 25 Mar 2025 22:08:20 GMT"} })
97202025-03-25T22:08:21.444ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
97212025-03-25T22:08:21.444ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
97222025-03-25T22:08:21.541ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "0199d5ef-dd9a-4dc4-b4eb-b9437eddf168", "date": "Tue, 25 Mar 2025 22:08:21 GMT"} })
97232025-03-25T22:08:21.541ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch = Switch0
97242025-03-25T22:08:21.541ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
97252025-03-25T22:08:21.542ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "09a65184-1abe-4b22-a569-c984bc6e861a", "content-length": "682", "date": "Tue, 25 Mar 2025 22:08:21 GMT"} })
97262025-03-25T22:08:21.542ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97272025-03-25T22:08:21.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97282025-03-25T22:08:21.546ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97292025-03-25T22:08:21.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97302025-03-25T22:08:21.549ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97312025-03-25T22:08:21.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97322025-03-25T22:08:21.551ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97332025-03-25T22:08:21.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97342025-03-25T22:08:21.558ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 714.268617ms iteration = 17 status = {}
97352025-03-25T22:08:22.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e17cade1-00e5-43f7-9969-3425c1f2521c roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
97362025-03-25T22:08:22.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e17cade1-00e5-43f7-9969-3425c1f2521c resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
97372025-03-25T22:08:22.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2261 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e17cade1-00e5-43f7-9969-3425c1f2521c response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
97382025-03-25T22:08:23.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 64e41a62-1603-4a7d-b673-1842c6551358 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
97392025-03-25T22:08:23.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 64e41a62-1603-4a7d-b673-1842c6551358 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
97402025-03-25T22:08:23.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2735 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 64e41a62-1603-4a7d-b673-1842c6551358 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
97412025-03-25T22:08:24.272ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7d4f9ea1-27a1-4749-9288-5e6a7cfbc64a roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
97422025-03-25T22:08:24.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7d4f9ea1-27a1-4749-9288-5e6a7cfbc64a resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
97432025-03-25T22:08:24.274ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2188 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7d4f9ea1-27a1-4749-9288-5e6a7cfbc64a response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
97442025-03-25T22:08:25.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0f5fb5e6-c2c6-43cf-97af-564097e1741e roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
97452025-03-25T22:08:25.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0f5fb5e6-c2c6-43cf-97af-564097e1741e resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
97462025-03-25T22:08:25.295ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2462 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0f5fb5e6-c2c6-43cf-97af-564097e1741e response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
97472025-03-25T22:08:26.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4710fec0-bb47-4879-bf47-a82a790f00e8 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
97482025-03-25T22:08:26.316ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4710fec0-bb47-4879-bf47-a82a790f00e8 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
97492025-03-25T22:08:26.318ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2361 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4710fec0-bb47-4879-bf47-a82a790f00e8 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
97502025-03-25T22:08:27.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1d4bada8-4f19-4831-a3ac-d82fe510d48f roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
97512025-03-25T22:08:27.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1d4bada8-4f19-4831-a3ac-d82fe510d48f resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
97522025-03-25T22:08:27.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2395 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1d4bada8-4f19-4831-a3ac-d82fe510d48f response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
97532025-03-25T22:08:28.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b8cf9a3f-02b6-4f63-b64b-12628acf143e roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
97542025-03-25T22:08:28.359ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b8cf9a3f-02b6-4f63-b64b-12628acf143e resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
97552025-03-25T22:08:28.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2015 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b8cf9a3f-02b6-4f63-b64b-12628acf143e response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
97562025-03-25T22:08:28.573ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 473 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = 033a03f4-c64d-4847-a897-d9a903263907 response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
97572025-03-25T22:08:29.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 81d188b1-fae3-4a4f-9990-855eae6923ab roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
97582025-03-25T22:08:29.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 81d188b1-fae3-4a4f-9990-855eae6923ab resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
97592025-03-25T22:08:29.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2297 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 81d188b1-fae3-4a4f-9990-855eae6923ab response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
97602025-03-25T22:08:30.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f761c386-4351-4ae2-bc08-5a12f94f4167 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
97612025-03-25T22:08:30.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f761c386-4351-4ae2-bc08-5a12f94f4167 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
97622025-03-25T22:08:30.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2144 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f761c386-4351-4ae2-bc08-5a12f94f4167 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
97632025-03-25T22:08:30.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
97642025-03-25T22:08:30.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97652025-03-25T22:08:30.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97662025-03-25T22:08:30.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
97672025-03-25T22:08:30.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97682025-03-25T22:08:30.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97692025-03-25T22:08:30.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97702025-03-25T22:08:30.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
97712025-03-25T22:08:30.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97722025-03-25T22:08:30.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97732025-03-25T22:08:30.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97742025-03-25T22:08:30.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97752025-03-25T22:08:30.873ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97762025-03-25T22:08:30.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97772025-03-25T22:08:30.881ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97782025-03-25T22:08:30.884ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
97792025-03-25T22:08:30.884ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97802025-03-25T22:08:30.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97812025-03-25T22:08:30.897ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
97822025-03-25T22:08:30.897ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 54.38935ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
97832025-03-25T22:08:30.912ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 67.807655ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
97842025-03-25T22:08:31.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = cf2346e3-c71d-4a3c-b066-782a9602944a roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
97852025-03-25T22:08:31.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = cf2346e3-c71d-4a3c-b066-782a9602944a resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
97862025-03-25T22:08:31.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2285 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = cf2346e3-c71d-4a3c-b066-782a9602944a response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
97872025-03-25T22:08:32.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8aaebbf2-ecb4-47e5-9854-766c38de8710 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
97882025-03-25T22:08:32.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8aaebbf2-ecb4-47e5-9854-766c38de8710 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
97892025-03-25T22:08:32.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2019 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8aaebbf2-ecb4-47e5-9854-766c38de8710 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
97902025-03-25T22:08:33.470ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4b3ba7e6-4b8b-4046-9e22-fc144ec0f4b0 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
97912025-03-25T22:08:33.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4b3ba7e6-4b8b-4046-9e22-fc144ec0f4b0 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
97922025-03-25T22:08:33.473ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2337 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4b3ba7e6-4b8b-4046-9e22-fc144ec0f4b0 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
97932025-03-25T22:08:34.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c4ff3cee-27e2-441a-8c00-acb7379b94c2 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
97942025-03-25T22:08:34.494ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c4ff3cee-27e2-441a-8c00-acb7379b94c2 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
97952025-03-25T22:08:34.496ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2034 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c4ff3cee-27e2-441a-8c00-acb7379b94c2 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
97962025-03-25T22:08:35.516ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 9ac79571-7eb6-44f7-b504-db522e6c0ea3 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
97972025-03-25T22:08:35.516ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 9ac79571-7eb6-44f7-b504-db522e6c0ea3 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
97982025-03-25T22:08:35.518ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2148 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 9ac79571-7eb6-44f7-b504-db522e6c0ea3 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
97992025-03-25T22:08:36.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 161d2246-11d9-46a0-b296-c128cb5a147f roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
98002025-03-25T22:08:36.538ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 161d2246-11d9-46a0-b296-c128cb5a147f resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
98012025-03-25T22:08:36.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2233 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 161d2246-11d9-46a0-b296-c128cb5a147f response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
98022025-03-25T22:08:37.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 70ccf6cc-9224-40e3-856d-f9b3e80bed8b roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
98032025-03-25T22:08:37.560ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 70ccf6cc-9224-40e3-856d-f9b3e80bed8b resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
98042025-03-25T22:08:37.562ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2323 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 70ccf6cc-9224-40e3-856d-f9b3e80bed8b response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
98052025-03-25T22:08:38.573ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 718 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = 4644e14e-56ac-4796-b467-99f37185f26a response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
98062025-03-25T22:08:38.582ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 094d989d-c430-4639-ba44-e4b97bff2a92 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
98072025-03-25T22:08:38.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 094d989d-c430-4639-ba44-e4b97bff2a92 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
98082025-03-25T22:08:38.584ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2073 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 094d989d-c430-4639-ba44-e4b97bff2a92 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
98092025-03-25T22:08:39.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = fb0ae03b-ef4d-486a-8e41-440146863a1f roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
98102025-03-25T22:08:39.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = fb0ae03b-ef4d-486a-8e41-440146863a1f resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
98112025-03-25T22:08:39.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1975 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = fb0ae03b-ef4d-486a-8e41-440146863a1f response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
98122025-03-25T22:08:40.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e1f52aca-2820-4904-857a-21466fe7b6ab roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
98132025-03-25T22:08:40.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e1f52aca-2820-4904-857a-21466fe7b6ab resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
98142025-03-25T22:08:40.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1829 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e1f52aca-2820-4904-857a-21466fe7b6ab response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
98152025-03-25T22:08:40.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
98162025-03-25T22:08:40.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98172025-03-25T22:08:40.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98182025-03-25T22:08:40.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
98192025-03-25T22:08:40.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
98202025-03-25T22:08:40.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
98212025-03-25T22:08:40.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98222025-03-25T22:08:40.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
98232025-03-25T22:08:40.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98242025-03-25T22:08:40.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98252025-03-25T22:08:40.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98262025-03-25T22:08:40.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98272025-03-25T22:08:40.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98282025-03-25T22:08:40.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
98292025-03-25T22:08:40.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98302025-03-25T22:08:40.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98312025-03-25T22:08:40.862ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
98322025-03-25T22:08:40.862ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.669016ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
98332025-03-25T22:08:40.874ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
98342025-03-25T22:08:40.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
98352025-03-25T22:08:40.875ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.713944ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
98362025-03-25T22:08:41.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0eeff855-0b41-4bbd-a85e-d19fa7bed191 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
98372025-03-25T22:08:41.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0eeff855-0b41-4bbd-a85e-d19fa7bed191 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
98382025-03-25T22:08:41.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2255 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0eeff855-0b41-4bbd-a85e-d19fa7bed191 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
98392025-03-25T22:08:42.671ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 94ef4ca3-c528-48c3-9fc0-02cb795aa48b roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
98402025-03-25T22:08:42.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 94ef4ca3-c528-48c3-9fc0-02cb795aa48b resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
98412025-03-25T22:08:42.673ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2336 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 94ef4ca3-c528-48c3-9fc0-02cb795aa48b response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
98422025-03-25T22:08:43.694ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e2a9a31c-8090-46a9-9221-8e2fd50414fa roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
98432025-03-25T22:08:43.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e2a9a31c-8090-46a9-9221-8e2fd50414fa resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
98442025-03-25T22:08:43.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2198 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e2a9a31c-8090-46a9-9221-8e2fd50414fa response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
98452025-03-25T22:08:44.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5a8731aa-6a70-45a1-8d36-16bc2c9370b0 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
98462025-03-25T22:08:44.717ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5a8731aa-6a70-45a1-8d36-16bc2c9370b0 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
98472025-03-25T22:08:44.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1852 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5a8731aa-6a70-45a1-8d36-16bc2c9370b0 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
98482025-03-25T22:08:45.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3b05bb08-6165-4f63-9716-bc03126202fc roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
98492025-03-25T22:08:45.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3b05bb08-6165-4f63-9716-bc03126202fc resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
98502025-03-25T22:08:45.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2536 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3b05bb08-6165-4f63-9716-bc03126202fc response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
98512025-03-25T22:08:46.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d4c33cdb-18b6-469e-9808-d41d11dcf50a roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
98522025-03-25T22:08:46.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d4c33cdb-18b6-469e-9808-d41d11dcf50a resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
98532025-03-25T22:08:46.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2242 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d4c33cdb-18b6-469e-9808-d41d11dcf50a response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
98542025-03-25T22:08:47.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7e1ce6bf-cdc6-4366-8f79-3d5d2f7102f4 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
98552025-03-25T22:08:47.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7e1ce6bf-cdc6-4366-8f79-3d5d2f7102f4 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
98562025-03-25T22:08:47.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2356 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7e1ce6bf-cdc6-4366-8f79-3d5d2f7102f4 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
98572025-03-25T22:08:48.573ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 568 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = d0003465-5c25-4307-bc36-ab6e67192265 response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
98582025-03-25T22:08:48.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3dea6730-4fcd-4f65-8582-9555adc8bcd0 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
98592025-03-25T22:08:48.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3dea6730-4fcd-4f65-8582-9555adc8bcd0 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
98602025-03-25T22:08:48.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1985 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3dea6730-4fcd-4f65-8582-9555adc8bcd0 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
98612025-03-25T22:08:49.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 73c97a78-da0e-4bbe-96b9-83a10a890efc roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
98622025-03-25T22:08:49.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 73c97a78-da0e-4bbe-96b9-83a10a890efc resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
98632025-03-25T22:08:49.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2274 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 73c97a78-da0e-4bbe-96b9-83a10a890efc response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
98642025-03-25T22:08:50.843ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
98652025-03-25T22:08:50.843ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
98662025-03-25T22:08:50.843ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
98672025-03-25T22:08:50.843ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
98682025-03-25T22:08:50.843ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
98692025-03-25T22:08:50.843ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
98702025-03-25T22:08:50.843ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98712025-03-25T22:08:50.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
98722025-03-25T22:08:50.843ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
98732025-03-25T22:08:50.843ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98742025-03-25T22:08:50.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98752025-03-25T22:08:50.844ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
98762025-03-25T22:08:50.844ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
98772025-03-25T22:08:50.844ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
98782025-03-25T22:08:50.844ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98792025-03-25T22:08:50.844ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 18 reason = Timeout
98802025-03-25T22:08:50.844ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
98812025-03-25T22:08:50.844ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
98822025-03-25T22:08:50.844ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
98832025-03-25T22:08:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
98842025-03-25T22:08:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
98852025-03-25T22:08:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
98862025-03-25T22:08:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98872025-03-25T22:08:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98882025-03-25T22:08:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98892025-03-25T22:08:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
98902025-03-25T22:08:50.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
98912025-03-25T22:08:50.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
98922025-03-25T22:08:50.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
98932025-03-25T22:08:50.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
98942025-03-25T22:08:50.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
98952025-03-25T22:08:50.844ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
98962025-03-25T22:08:50.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
98972025-03-25T22:08:50.844ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
98982025-03-25T22:08:50.844ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
98992025-03-25T22:08:50.844ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99002025-03-25T22:08:50.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
99012025-03-25T22:08:50.844ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 18 reason = Timeout
99022025-03-25T22:08:50.844ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
99032025-03-25T22:08:50.844ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
99042025-03-25T22:08:50.844ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
99052025-03-25T22:08:50.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
99062025-03-25T22:08:50.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
99072025-03-25T22:08:50.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99082025-03-25T22:08:50.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
99092025-03-25T22:08:50.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
99102025-03-25T22:08:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
99112025-03-25T22:08:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99122025-03-25T22:08:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
99132025-03-25T22:08:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
99142025-03-25T22:08:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
99152025-03-25T22:08:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
99162025-03-25T22:08:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
99172025-03-25T22:08:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
99182025-03-25T22:08:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99192025-03-25T22:08:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99202025-03-25T22:08:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
99212025-03-25T22:08:50.846ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6684, tv_nsec: 182709780 } })
99222025-03-25T22:08:50.847ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1171
99232025-03-25T22:08:50.847ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99242025-03-25T22:08:50.847ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.062791ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
99252025-03-25T22:08:50.848ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99262025-03-25T22:08:50.848ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99272025-03-25T22:08:50.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 76d09022-2dbd-41fc-9ad6-9d24e674f082 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
99282025-03-25T22:08:50.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 76d09022-2dbd-41fc-9ad6-9d24e674f082 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
99292025-03-25T22:08:50.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
99302025-03-25T22:08:50.850ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
99312025-03-25T22:08:50.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
99322025-03-25T22:08:50.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
99332025-03-25T22:08:50.850ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99342025-03-25T22:08:50.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99352025-03-25T22:08:50.851ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
99362025-03-25T22:08:50.851ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
99372025-03-25T22:08:50.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
99382025-03-25T22:08:50.852ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6684, tv_nsec: 188571373 } })
99392025-03-25T22:08:50.852ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1171
99402025-03-25T22:08:50.862ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 13395 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 76d09022-2dbd-41fc-9ad6-9d24e674f082 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
99412025-03-25T22:08:50.862ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
99422025-03-25T22:08:50.862ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
99432025-03-25T22:08:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
99442025-03-25T22:08:50.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
99452025-03-25T22:08:50.863ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6684, tv_nsec: 199353601 } })
99462025-03-25T22:08:50.863ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1171 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
99472025-03-25T22:08:50.891ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
99482025-03-25T22:08:50.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
99492025-03-25T22:08:50.894ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99502025-03-25T22:08:50.897ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
99512025-03-25T22:08:50.897ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
99522025-03-25T22:08:50.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
99532025-03-25T22:08:50.898ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
99542025-03-25T22:08:50.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
99552025-03-25T22:08:50.899ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 54.732886ms iteration = 18 status = {"errors":[],"requests_created_ok":[]}
99562025-03-25T22:08:50.900ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
99572025-03-25T22:08:50.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
99582025-03-25T22:08:50.902ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
99592025-03-25T22:08:50.902ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
99602025-03-25T22:08:50.902ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
99612025-03-25T22:08:50.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
99622025-03-25T22:08:50.905ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99632025-03-25T22:08:50.905ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
99642025-03-25T22:08:50.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
99652025-03-25T22:08:50.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
99662025-03-25T22:08:50.908ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
99672025-03-25T22:08:50.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
99682025-03-25T22:08:50.910ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 66.43274ms iteration = 18 status = {"errors":[],"finish_invoked_ok":[]}
99692025-03-25T22:08:50.910ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99702025-03-25T22:08:50.912ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99712025-03-25T22:08:50.912ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
99722025-03-25T22:08:50.912ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99732025-03-25T22:08:50.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99742025-03-25T22:08:50.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99752025-03-25T22:08:50.913ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 69.533284ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
99762025-03-25T22:08:50.914ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99772025-03-25T22:08:50.917ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 72.814702ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
99782025-03-25T22:08:50.917ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
99792025-03-25T22:08:50.917ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99802025-03-25T22:08:50.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99812025-03-25T22:08:50.920ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99822025-03-25T22:08:50.920ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
99832025-03-25T22:08:50.920ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
99842025-03-25T22:08:50.921ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f62b5761-00be-4a2d-90e2-9b4779e19af7", "content-length": "26", "date": "Tue, 25 Mar 2025 22:08:49 GMT"} })
99852025-03-25T22:08:50.921ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
99862025-03-25T22:08:50.921ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99872025-03-25T22:08:50.922ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
99882025-03-25T22:08:50.922ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
99892025-03-25T22:08:50.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
99902025-03-25T22:08:50.923ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
99912025-03-25T22:08:50.923ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
99922025-03-25T22:08:50.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
99932025-03-25T22:08:50.925ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
99942025-03-25T22:08:50.925ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99952025-03-25T22:08:50.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99962025-03-25T22:08:50.928ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99972025-03-25T22:08:50.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99982025-03-25T22:08:50.944ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99992025-03-25T22:08:50.944ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
100002025-03-25T22:08:50.944ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
100012025-03-25T22:08:50.945ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ccad100-153b-46cd-9720-d8c2833e28f9", "content-length": "26", "date": "Tue, 25 Mar 2025 22:08:49 GMT"} })
100022025-03-25T22:08:50.945ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
100032025-03-25T22:08:50.946ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
100042025-03-25T22:08:50.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
100052025-03-25T22:08:50.946ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
100062025-03-25T22:08:50.946ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f034aaf6-2037-4cb4-8409-3ab31c15cc28, lookup_type: ById(f034aaf6-2037-4cb4-8409-3ab31c15cc28) } result = Ok(())
100072025-03-25T22:08:50.946ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
100082025-03-25T22:08:50.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
100092025-03-25T22:08:50.948ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100102025-03-25T22:08:50.949ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 105.217968ms iteration = 18 status = 0
100112025-03-25T22:08:50.949ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 105.491303ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
100122025-03-25T22:08:50.950ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 105.966511ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
100132025-03-25T22:08:50.950ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
100142025-03-25T22:08:50.950ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
100152025-03-25T22:08:50.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
100162025-03-25T22:08:50.956ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
100172025-03-25T22:08:50.956ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 112.427464ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
100182025-03-25T22:08:50.957ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 zone_address = fd00:1122:3344:101::2
100192025-03-25T22:08:50.957ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
100202025-03-25T22:08:50.958ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f4950b28-c727-4d1f-94e2-723140ba1b14", "content-length": "26", "date": "Tue, 25 Mar 2025 22:08:49 GMT"} })
100212025-03-25T22:08:50.958ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1184 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
100222025-03-25T22:08:50.959ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
100232025-03-25T22:08:50.965ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100242025-03-25T22:08:50.966ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
100252025-03-25T22:08:50.966ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
100262025-03-25T22:08:50.966ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
100272025-03-25T22:08:50.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
100282025-03-25T22:08:50.966ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
100292025-03-25T22:08:50.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
100302025-03-25T22:08:50.968ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
100312025-03-25T22:08:50.968ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100322025-03-25T22:08:50.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100332025-03-25T22:08:50.978ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
100342025-03-25T22:08:50.979ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 135.159641ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
100352025-03-25T22:08:50.985ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
100362025-03-25T22:08:50.986ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4adb6776-07e9-4836-837a-c30539b0ac5b", "content-length": "1", "date": "Tue, 25 Mar 2025 22:08:50 GMT"} })
100372025-03-25T22:08:50.987ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
100382025-03-25T22:08:50.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
100392025-03-25T22:08:50.989ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 145.808727ms iteration = 18 status = null
100402025-03-25T22:08:50.994ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
100412025-03-25T22:08:50.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
100422025-03-25T22:08:50.996ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:360
100432025-03-25T22:08:50.996ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 153.005542ms iteration = 18 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
100442025-03-25T22:08:50.997ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 153.545562ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
100452025-03-25T22:08:50.999ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
100462025-03-25T22:08:50.999ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
100472025-03-25T22:08:50.999ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 155.207952ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
100482025-03-25T22:08:51.037ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 193.594802ms iteration = 20 status = {"physical_disks_added":0}
100492025-03-25T22:08:51.094ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 250.957214ms iteration = 18 status = {}
100502025-03-25T22:08:51.098ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
100512025-03-25T22:08:51.098ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
100522025-03-25T22:08:51.099ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "17a5b79e-ce3c-4313-bc56-48aca2459f7a", "content-length": "372", "date": "Tue, 25 Mar 2025 22:08:51 GMT"} })
100532025-03-25T22:08:51.099ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100542025-03-25T22:08:51.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100552025-03-25T22:08:51.143ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
100562025-03-25T22:08:51.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
100572025-03-25T22:08:51.146ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100582025-03-25T22:08:51.148ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
100592025-03-25T22:08:51.148ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
100602025-03-25T22:08:51.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
100612025-03-25T22:08:51.150ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100622025-03-25T22:08:51.153ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
100632025-03-25T22:08:51.153ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
100642025-03-25T22:08:51.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
100652025-03-25T22:08:51.168ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
100662025-03-25T22:08:51.168ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
100672025-03-25T22:08:51.168ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c3a19719-1843-4b8b-858c-7bb37778cb0b", "date": "Tue, 25 Mar 2025 22:08:51 GMT"} })
100682025-03-25T22:08:51.168ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100692025-03-25T22:08:51.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100702025-03-25T22:08:51.171ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100712025-03-25T22:08:51.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100722025-03-25T22:08:51.174ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100732025-03-25T22:08:51.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100742025-03-25T22:08:51.177ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
100752025-03-25T22:08:51.177ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
100762025-03-25T22:08:51.177ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "417d86d5-9734-4927-8ac9-c78d84533aa3", "date": "Tue, 25 Mar 2025 22:08:51 GMT"} })
100772025-03-25T22:08:51.179ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 334.821839ms iteration = 18 status = {}
100782025-03-25T22:08:51.199ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100792025-03-25T22:08:51.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100802025-03-25T22:08:51.200ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a5db250-fa3f-4168-ab16-5c36568c22e2, rack_id: c7210e4b-5a81-4ec8-b8fe-816a9508dc74, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(6d5dda50-e3c4-4853-9bfa-a66b447ab351) } rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
100812025-03-25T22:08:51.200ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100822025-03-25T22:08:51.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100832025-03-25T22:08:51.204ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
100842025-03-25T22:08:51.204ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c3724e5c-aad3-4b6c-91f1-6ca2646e29a6", "content-length": "691", "date": "Tue, 25 Mar 2025 22:08:51 GMT"} })
100852025-03-25T22:08:51.204ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
100862025-03-25T22:08:51.204ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
100872025-03-25T22:08:51.204ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
100882025-03-25T22:08:51.205ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 361.993423ms iteration = 18 status = {}
100892025-03-25T22:08:51.216ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
100902025-03-25T22:08:51.216ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "f3d04604-9e2c-484a-a337-1204353389a1", "content-length": "134", "date": "Tue, 25 Mar 2025 22:08:50 GMT"} })
100912025-03-25T22:08:51.216ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
100922025-03-25T22:08:51.216ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 6d5dda50-e3c4-4853-9bfa-a66b447ab351
100932025-03-25T22:08:51.216ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
100942025-03-25T22:08:51.216ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
100952025-03-25T22:08:51.216ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
100962025-03-25T22:08:51.216ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
100972025-03-25T22:08:51.216ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
100982025-03-25T22:08:51.216ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
100992025-03-25T22:08:51.216ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
101002025-03-25T22:08:51.216ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
101012025-03-25T22:08:51.217ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
101022025-03-25T22:08:51.217ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
101032025-03-25T22:08:51.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
101042025-03-25T22:08:51.218ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
101052025-03-25T22:08:51.218ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6f6e1a0-2bd4-4705-9959-fed6093b4a3e", "content-length": "2", "date": "Tue, 25 Mar 2025 22:08:50 GMT"} })
101062025-03-25T22:08:51.218ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
101072025-03-25T22:08:51.218ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "9734a27f-189e-4260-871e-287743003a79", "content-length": "52", "date": "Tue, 25 Mar 2025 22:08:51 GMT"} })
101082025-03-25T22:08:51.218ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
101092025-03-25T22:08:51.218ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
101102025-03-25T22:08:51.318ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "3890afe0-2f2c-4529-81ba-7de2d7a51ded", "date": "Tue, 25 Mar 2025 22:08:51 GMT"} })
101112025-03-25T22:08:51.318ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch = Switch0
101122025-03-25T22:08:51.318ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
101132025-03-25T22:08:51.319ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "11052795-91c9-4ce5-8274-a2110678edb9", "content-length": "682", "date": "Tue, 25 Mar 2025 22:08:51 GMT"} })
101142025-03-25T22:08:51.319ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
101152025-03-25T22:08:51.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
101162025-03-25T22:08:51.322ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
101172025-03-25T22:08:51.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
101182025-03-25T22:08:51.325ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
101192025-03-25T22:08:51.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
101202025-03-25T22:08:51.327ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
101212025-03-25T22:08:51.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
101222025-03-25T22:08:51.334ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 491.047498ms iteration = 18 status = {}
101232025-03-25T22:08:51.628ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
101242025-03-25T22:08:51.628ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
101252025-03-25T22:08:51.658ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
101262025-03-25T22:08:51.658ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:64125
101272025-03-25T22:08:51.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:64125 req_id = 782dfa94-89ad-428b-985c-8deaeeda386e roles = RoleSet { roles: {} } uri = /metrics/producers
101282025-03-25T22:08:51.659ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:64125 req_id = 782dfa94-89ad-428b-985c-8deaeeda386e resource = Database result = Ok(()) uri = /metrics/producers
101292025-03-25T22:08:51.699ZINFOnexus: assigned collector to new producer collector_id = ec539d60-a406-4fe9-a658-fbc8b3fb545b file = nexus/src/app/oximeter.rs:76 producer_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
101302025-03-25T22:08:51.699ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 40597 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:64125 req_id = 782dfa94-89ad-428b-985c-8deaeeda386e response_code = 201 uri = /metrics/producers
101312025-03-25T22:08:51.699ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "782dfa94-89ad-428b-985c-8deaeeda386e", "content-length": "41", "date": "Tue, 25 Mar 2025 22:08:51 GMT"} })
101322025-03-25T22:08:51.700ZDEBGnexus (producer-registration-task): registered with nexus successfully
101332025-03-25T22:08:51.700ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
101342025-03-25T22:08:51.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 481d1d45-91cc-4820-b888-bb60ea6e586b roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
101352025-03-25T22:08:51.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 481d1d45-91cc-4820-b888-bb60ea6e586b resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
101362025-03-25T22:08:51.895ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1971 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 481d1d45-91cc-4820-b888-bb60ea6e586b response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
101372025-03-25T22:08:52.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = fb519256-5aef-456e-80ac-f906a1657724 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
101382025-03-25T22:08:52.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = fb519256-5aef-456e-80ac-f906a1657724 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
101392025-03-25T22:08:52.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2214 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = fb519256-5aef-456e-80ac-f906a1657724 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
101402025-03-25T22:08:53.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = dca9ea9b-929f-4794-bd8c-32f340a38874 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
101412025-03-25T22:08:53.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = dca9ea9b-929f-4794-bd8c-32f340a38874 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
101422025-03-25T22:08:53.938ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2140 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = dca9ea9b-929f-4794-bd8c-32f340a38874 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
101432025-03-25T22:08:54.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 965600b6-21d1-4880-b2b4-e18e22fc9000 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
101442025-03-25T22:08:54.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 965600b6-21d1-4880-b2b4-e18e22fc9000 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
101452025-03-25T22:08:54.959ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2420 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 965600b6-21d1-4880-b2b4-e18e22fc9000 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
101462025-03-25T22:08:55.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 61863713-1c65-4cb2-8613-f381ead6a436 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
101472025-03-25T22:08:55.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 61863713-1c65-4cb2-8613-f381ead6a436 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
101482025-03-25T22:08:55.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1887 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 61863713-1c65-4cb2-8613-f381ead6a436 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
101492025-03-25T22:08:57.001ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3b621136-60df-4c29-9dc5-01cbc904340f roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
101502025-03-25T22:08:57.001ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3b621136-60df-4c29-9dc5-01cbc904340f resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
101512025-03-25T22:08:57.003ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1964 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3b621136-60df-4c29-9dc5-01cbc904340f response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
101522025-03-25T22:08:58.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b076fb7f-51dc-49b9-989f-fd7b1956d008 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
101532025-03-25T22:08:58.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b076fb7f-51dc-49b9-989f-fd7b1956d008 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
101542025-03-25T22:08:58.026ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2290 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b076fb7f-51dc-49b9-989f-fd7b1956d008 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
101552025-03-25T22:08:58.565ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:34262
101562025-03-25T22:08:58.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34262 req_id = cbf9c440-71b6-4777-8439-95cc00e80b49 roles = RoleSet { roles: {} } uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
101572025-03-25T22:08:58.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34262 req_id = cbf9c440-71b6-4777-8439-95cc00e80b49 resource = Database result = Ok(()) uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
101582025-03-25T22:08:58.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2983 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34262 req_id = cbf9c440-71b6-4777-8439-95cc00e80b49 response_code = 200 uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
101592025-03-25T22:08:58.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34262 req_id = 4776fd4e-e7de-4125-8375-a4f23d02f197 roles = RoleSet { roles: {} } uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
101602025-03-25T22:08:58.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34262 req_id = 4776fd4e-e7de-4125-8375-a4f23d02f197 resource = Database result = Ok(()) uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
101612025-03-25T22:08:58.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2796 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34262 req_id = 4776fd4e-e7de-4125-8375-a4f23d02f197 response_code = 200 uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
101622025-03-25T22:08:58.573ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 462 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = 6be9acd6-73a9-415f-a1e9-c7b33ee27349 response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
101632025-03-25T22:08:59.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c77a19d7-9bf3-46a6-92c2-a48cca4efd25 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
101642025-03-25T22:08:59.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c77a19d7-9bf3-46a6-92c2-a48cca4efd25 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
101652025-03-25T22:08:59.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1854 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c77a19d7-9bf3-46a6-92c2-a48cca4efd25 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
101662025-03-25T22:09:00.067ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3cd3c636-d874-43d7-a6e9-423eda4dcb8d roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
101672025-03-25T22:09:00.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3cd3c636-d874-43d7-a6e9-423eda4dcb8d resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
101682025-03-25T22:09:00.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2597 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3cd3c636-d874-43d7-a6e9-423eda4dcb8d response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
101692025-03-25T22:09:00.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
101702025-03-25T22:09:00.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101712025-03-25T22:09:00.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101722025-03-25T22:09:00.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
101732025-03-25T22:09:00.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101742025-03-25T22:09:00.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101752025-03-25T22:09:00.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101762025-03-25T22:09:00.846ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101772025-03-25T22:09:00.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101782025-03-25T22:09:00.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
101792025-03-25T22:09:00.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101802025-03-25T22:09:00.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101812025-03-25T22:09:00.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101822025-03-25T22:09:00.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101832025-03-25T22:09:00.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101842025-03-25T22:09:00.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
101852025-03-25T22:09:00.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101862025-03-25T22:09:00.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101872025-03-25T22:09:00.860ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
101882025-03-25T22:09:00.860ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.766243ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
101892025-03-25T22:09:00.877ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.404533ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
101902025-03-25T22:09:01.089ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = db1dab4e-c067-48c5-a294-dde0dcfc185f roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
101912025-03-25T22:09:01.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = db1dab4e-c067-48c5-a294-dde0dcfc185f resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
101922025-03-25T22:09:01.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2310 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = db1dab4e-c067-48c5-a294-dde0dcfc185f response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
101932025-03-25T22:09:02.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b726826e-c0bd-41ae-bcb0-c678c310580a roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
101942025-03-25T22:09:02.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b726826e-c0bd-41ae-bcb0-c678c310580a resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
101952025-03-25T22:09:02.114ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1882 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b726826e-c0bd-41ae-bcb0-c678c310580a response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
101962025-03-25T22:09:03.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 9f30d5e2-153d-4509-a940-1cfdfe8456b2 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
101972025-03-25T22:09:03.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 9f30d5e2-153d-4509-a940-1cfdfe8456b2 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
101982025-03-25T22:09:03.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2543 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 9f30d5e2-153d-4509-a940-1cfdfe8456b2 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
101992025-03-25T22:09:04.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f6b1c0a8-c1d9-4a53-ba82-5166a3593b07 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102002025-03-25T22:09:04.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f6b1c0a8-c1d9-4a53-ba82-5166a3593b07 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102012025-03-25T22:09:04.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2221 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f6b1c0a8-c1d9-4a53-ba82-5166a3593b07 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102022025-03-25T22:09:05.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e952afde-3773-4166-aef5-e4846210c9f0 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102032025-03-25T22:09:05.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e952afde-3773-4166-aef5-e4846210c9f0 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102042025-03-25T22:09:05.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2299 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e952afde-3773-4166-aef5-e4846210c9f0 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102052025-03-25T22:09:06.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2de9f9e0-235b-4c96-8f9e-2f593469e968 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102062025-03-25T22:09:06.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2de9f9e0-235b-4c96-8f9e-2f593469e968 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102072025-03-25T22:09:06.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1949 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2de9f9e0-235b-4c96-8f9e-2f593469e968 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102082025-03-25T22:09:07.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 82b51a6f-772e-4813-85ec-c3e710b055d8 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102092025-03-25T22:09:07.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 82b51a6f-772e-4813-85ec-c3e710b055d8 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102102025-03-25T22:09:07.222ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2091 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 82b51a6f-772e-4813-85ec-c3e710b055d8 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102112025-03-25T22:09:08.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f1d3ffdb-90a8-48d6-88a6-b59f9dfd6e52 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102122025-03-25T22:09:08.242ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f1d3ffdb-90a8-48d6-88a6-b59f9dfd6e52 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102132025-03-25T22:09:08.244ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2399 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f1d3ffdb-90a8-48d6-88a6-b59f9dfd6e52 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102142025-03-25T22:09:08.573ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 572 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = 7f3c229c-2482-4ae5-a87b-7ba7f275ca5f response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
102152025-03-25T22:09:09.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 94d8d7dd-fb8e-416a-b5c8-5d0084c7972b roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102162025-03-25T22:09:09.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 94d8d7dd-fb8e-416a-b5c8-5d0084c7972b resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102172025-03-25T22:09:09.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1920 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 94d8d7dd-fb8e-416a-b5c8-5d0084c7972b response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102182025-03-25T22:09:10.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5e98585b-7aea-4fcc-ac84-18e93b968043 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102192025-03-25T22:09:10.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5e98585b-7aea-4fcc-ac84-18e93b968043 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102202025-03-25T22:09:10.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1861 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5e98585b-7aea-4fcc-ac84-18e93b968043 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102212025-03-25T22:09:10.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
102222025-03-25T22:09:10.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102232025-03-25T22:09:10.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102242025-03-25T22:09:10.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
102252025-03-25T22:09:10.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
102262025-03-25T22:09:10.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
102272025-03-25T22:09:10.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102282025-03-25T22:09:10.846ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
102292025-03-25T22:09:10.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
102302025-03-25T22:09:10.847ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.185906ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
102312025-03-25T22:09:10.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
102322025-03-25T22:09:10.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102332025-03-25T22:09:10.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102342025-03-25T22:09:10.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102352025-03-25T22:09:10.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102362025-03-25T22:09:10.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102372025-03-25T22:09:10.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
102382025-03-25T22:09:10.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102392025-03-25T22:09:10.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102402025-03-25T22:09:10.863ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
102412025-03-25T22:09:10.863ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.01952ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
102422025-03-25T22:09:11.308ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 079024cd-803e-4013-896e-fbf0644cad78 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102432025-03-25T22:09:11.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 079024cd-803e-4013-896e-fbf0644cad78 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102442025-03-25T22:09:11.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1784 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 079024cd-803e-4013-896e-fbf0644cad78 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102452025-03-25T22:09:12.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = cc0a355c-5611-401e-a1de-abef65cfd6c8 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102462025-03-25T22:09:12.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = cc0a355c-5611-401e-a1de-abef65cfd6c8 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102472025-03-25T22:09:12.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2599 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = cc0a355c-5611-401e-a1de-abef65cfd6c8 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102482025-03-25T22:09:13.353ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = cf55c188-e6cf-4427-9349-e157bff4ff7d roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102492025-03-25T22:09:13.354ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = cf55c188-e6cf-4427-9349-e157bff4ff7d resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102502025-03-25T22:09:13.356ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2716 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = cf55c188-e6cf-4427-9349-e157bff4ff7d response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102512025-03-25T22:09:13.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34262 req_id = 39f949ad-29f0-4a3d-8988-c72b29ec1d75 roles = RoleSet { roles: {} } uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
102522025-03-25T22:09:13.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34262 req_id = 39f949ad-29f0-4a3d-8988-c72b29ec1d75 resource = Database result = Ok(()) uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
102532025-03-25T22:09:13.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3251 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34262 req_id = 39f949ad-29f0-4a3d-8988-c72b29ec1d75 response_code = 200 uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
102542025-03-25T22:09:13.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34262 req_id = 0ca39477-6a7c-4924-a307-46c33ae896b9 roles = RoleSet { roles: {} } uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
102552025-03-25T22:09:13.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34262 req_id = 0ca39477-6a7c-4924-a307-46c33ae896b9 resource = Database result = Ok(()) uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
102562025-03-25T22:09:13.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2121 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34262 req_id = 0ca39477-6a7c-4924-a307-46c33ae896b9 response_code = 200 uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
102572025-03-25T22:09:14.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 9285075f-39a0-4f89-b69c-c1c5b510367b roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102582025-03-25T22:09:14.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 9285075f-39a0-4f89-b69c-c1c5b510367b resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102592025-03-25T22:09:14.386ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4046 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 9285075f-39a0-4f89-b69c-c1c5b510367b response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102602025-03-25T22:09:15.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8af04f9f-ca00-431f-b872-ef076eb48a4b roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102612025-03-25T22:09:15.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8af04f9f-ca00-431f-b872-ef076eb48a4b resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102622025-03-25T22:09:15.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2551 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8af04f9f-ca00-431f-b872-ef076eb48a4b response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102632025-03-25T22:09:16.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c15d3505-53b3-484d-ba0e-c4c7d3a304de roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102642025-03-25T22:09:16.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c15d3505-53b3-484d-ba0e-c4c7d3a304de resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102652025-03-25T22:09:16.429ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2330 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c15d3505-53b3-484d-ba0e-c4c7d3a304de response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102662025-03-25T22:09:17.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 9fee59e0-fd8a-4e4f-a9f7-a72d2e9c06a1 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102672025-03-25T22:09:17.447ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 9fee59e0-fd8a-4e4f-a9f7-a72d2e9c06a1 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102682025-03-25T22:09:17.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2526 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 9fee59e0-fd8a-4e4f-a9f7-a72d2e9c06a1 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102692025-03-25T22:09:18.470ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 38962c3b-b849-4ede-a59b-a7892d1cc2e8 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102702025-03-25T22:09:18.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 38962c3b-b849-4ede-a59b-a7892d1cc2e8 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102712025-03-25T22:09:18.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2117 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 38962c3b-b849-4ede-a59b-a7892d1cc2e8 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102722025-03-25T22:09:18.573ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 465 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = e8e0c123-18cf-4615-ab87-be3225ffb56d response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
102732025-03-25T22:09:19.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5dae2a54-e224-414d-bd1d-d7774ad3a7ad roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102742025-03-25T22:09:19.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5dae2a54-e224-414d-bd1d-d7774ad3a7ad resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102752025-03-25T22:09:19.494ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2650 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5dae2a54-e224-414d-bd1d-d7774ad3a7ad response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102762025-03-25T22:09:20.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 15ea9188-2209-40eb-9e8c-52af9463e304 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102772025-03-25T22:09:20.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 15ea9188-2209-40eb-9e8c-52af9463e304 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102782025-03-25T22:09:20.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2723 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 15ea9188-2209-40eb-9e8c-52af9463e304 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
102792025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
102802025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
102812025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
102822025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
102832025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
102842025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
102852025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
102862025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
102872025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
102882025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
102892025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
102902025-03-25T22:09:20.844ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:82 reason = blueprint disabled target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7
102912025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
102922025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102932025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 21.141\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7"}
102942025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
102952025-03-25T22:09:20.844ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-03-25 21:59:20.844209805 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
102962025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
102972025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102982025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
102992025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
103002025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
103012025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
103022025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103032025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
103042025-03-25T22:09:20.844ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
103052025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
103062025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
103072025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
103082025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
103092025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
103102025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
103112025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
103122025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
103132025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
103142025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
103152025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
103162025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
103172025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
103182025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
103192025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 19 reason = Timeout
103202025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
103212025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
103222025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
103232025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
103242025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
103252025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
103262025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
103272025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
103282025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
103292025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
103302025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
103312025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
103322025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
103332025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
103342025-03-25T22:09:20.844ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
103352025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
103362025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103372025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
103382025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
103392025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
103402025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
103412025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
103422025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
103432025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 19 reason = Timeout
103442025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
103452025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
103462025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
103472025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
103482025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
103492025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103502025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
103512025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103522025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
103532025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
103542025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
103552025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
103562025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103572025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
103582025-03-25T22:09:20.844ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5533f428-2028-4269-b7b1-f15912c01133.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("66b022b6-2e12-413e-b4b7-56c4ad5bdd77.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f337d25b-c67a-4a32-89e1-e187aea97ed9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f337d25b-c67a-4a32-89e1-e187aea97ed9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 6714, tv_nsec: 180780316 } })
103592025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
103602025-03-25T22:09:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
103612025-03-25T22:09:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
103622025-03-25T22:09:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
103632025-03-25T22:09:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
103642025-03-25T22:09:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
103652025-03-25T22:09:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
103662025-03-25T22:09:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
103672025-03-25T22:09:20.845ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("58d382a7-99da-40a7-bc9f-2da7e9b156c1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d42076c6-06fe-4102-a978-c7d0a8dffb98.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d42076c6-06fe-4102-a978-c7d0a8dffb98.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 6714, tv_nsec: 180905648 } })
103682025-03-25T22:09:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
103692025-03-25T22:09:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
103702025-03-25T22:09:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
103712025-03-25T22:09:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
103722025-03-25T22:09:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
103732025-03-25T22:09:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
103742025-03-25T22:09:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103752025-03-25T22:09:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
103762025-03-25T22:09:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
103772025-03-25T22:09:20.845ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
103782025-03-25T22:09:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
103792025-03-25T22:09:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
103802025-03-25T22:09:20.845ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
103812025-03-25T22:09:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
103822025-03-25T22:09:20.845ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
103832025-03-25T22:09:20.845ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
103842025-03-25T22:09:20.845ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.424185ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
103852025-03-25T22:09:20.845ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
103862025-03-25T22:09:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
103872025-03-25T22:09:20.845ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.365464ms iteration = 10 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
103882025-03-25T22:09:20.846ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6714, tv_nsec: 182643189 } })
103892025-03-25T22:09:20.846ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6714, tv_nsec: 182665359 } })
103902025-03-25T22:09:20.847ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1171
103912025-03-25T22:09:20.847ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1171
103922025-03-25T22:09:20.847ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.298438ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
103932025-03-25T22:09:20.847ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103942025-03-25T22:09:20.848ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103952025-03-25T22:09:20.849ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-03-25 21:59:20.844209805 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
103962025-03-25T22:09:20.849ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.948926ms iteration = 10 status = {"expiration":"2025-03-25T21:59:20.844209805Z","pruned":[]}
103972025-03-25T22:09:20.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
103982025-03-25T22:09:20.849ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
103992025-03-25T22:09:20.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
104002025-03-25T22:09:20.850ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
104012025-03-25T22:09:20.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
104022025-03-25T22:09:20.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
104032025-03-25T22:09:20.850ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
104042025-03-25T22:09:20.850ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
104052025-03-25T22:09:20.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
104062025-03-25T22:09:20.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
104072025-03-25T22:09:20.851ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104082025-03-25T22:09:20.852ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104092025-03-25T22:09:20.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
104102025-03-25T22:09:20.853ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104112025-03-25T22:09:20.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104122025-03-25T22:09:20.854ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104132025-03-25T22:09:20.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
104142025-03-25T22:09:20.855ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
104152025-03-25T22:09:20.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
104162025-03-25T22:09:20.856ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
104172025-03-25T22:09:20.856ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
104182025-03-25T22:09:20.856ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
104192025-03-25T22:09:20.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
104202025-03-25T22:09:20.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
104212025-03-25T22:09:20.858ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 14.384381ms iteration = 19 status = {"errors":[],"requests_created_ok":[]}
104222025-03-25T22:09:20.859ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
104232025-03-25T22:09:20.859ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
104242025-03-25T22:09:20.859ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 14.677526ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
104252025-03-25T22:09:20.859ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104262025-03-25T22:09:20.860ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104272025-03-25T22:09:20.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
104282025-03-25T22:09:20.862ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
104292025-03-25T22:09:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
104302025-03-25T22:09:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
104312025-03-25T22:09:20.863ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
104322025-03-25T22:09:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
104332025-03-25T22:09:20.865ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104342025-03-25T22:09:20.866ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104352025-03-25T22:09:20.868ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
104362025-03-25T22:09:20.868ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104372025-03-25T22:09:20.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104382025-03-25T22:09:20.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
104392025-03-25T22:09:20.869ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
104402025-03-25T22:09:20.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
104412025-03-25T22:09:20.871ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 26.634206ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
104422025-03-25T22:09:20.871ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104432025-03-25T22:09:20.873ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104442025-03-25T22:09:20.875ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
104452025-03-25T22:09:20.875ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
104462025-03-25T22:09:20.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
104472025-03-25T22:09:20.875ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104482025-03-25T22:09:20.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
104492025-03-25T22:09:20.878ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
104502025-03-25T22:09:20.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
104512025-03-25T22:09:20.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
104522025-03-25T22:09:20.879ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104532025-03-25T22:09:20.882ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
104542025-03-25T22:09:20.882ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
104552025-03-25T22:09:20.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
104562025-03-25T22:09:20.886ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
104572025-03-25T22:09:20.886ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
104582025-03-25T22:09:20.886ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
104592025-03-25T22:09:20.886ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
104602025-03-25T22:09:20.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
104612025-03-25T22:09:20.891ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6714, tv_nsec: 227177557 } })
104622025-03-25T22:09:20.891ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1171 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
104632025-03-25T22:09:20.897ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104642025-03-25T22:09:20.900ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
104652025-03-25T22:09:20.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104662025-03-25T22:09:20.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104672025-03-25T22:09:20.901ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104682025-03-25T22:09:20.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104692025-03-25T22:09:20.902ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
104702025-03-25T22:09:20.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
104712025-03-25T22:09:20.905ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104722025-03-25T22:09:20.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
104732025-03-25T22:09:20.908ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
104742025-03-25T22:09:20.908ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
104752025-03-25T22:09:20.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
104762025-03-25T22:09:20.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
104772025-03-25T22:09:20.910ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
104782025-03-25T22:09:20.911ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
104792025-03-25T22:09:20.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
104802025-03-25T22:09:20.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
104812025-03-25T22:09:20.912ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
104822025-03-25T22:09:20.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
104832025-03-25T22:09:20.912ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104842025-03-25T22:09:20.916ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
104852025-03-25T22:09:20.916ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104862025-03-25T22:09:20.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104872025-03-25T22:09:20.918ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 74.796337ms iteration = 5 status = {"nsuccess":5}
104882025-03-25T22:09:20.919ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
104892025-03-25T22:09:20.919ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
104902025-03-25T22:09:20.919ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
104912025-03-25T22:09:20.919ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104922025-03-25T22:09:20.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
104932025-03-25T22:09:20.922ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 78.314088ms iteration = 19 status = {"errors":[],"finish_invoked_ok":[]}
104942025-03-25T22:09:20.924ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
104952025-03-25T22:09:20.924ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
104962025-03-25T22:09:20.927ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 83.04245ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
104972025-03-25T22:09:20.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
104982025-03-25T22:09:20.929ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
104992025-03-25T22:09:20.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
105002025-03-25T22:09:20.932ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105012025-03-25T22:09:20.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105022025-03-25T22:09:20.935ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
105032025-03-25T22:09:20.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
105042025-03-25T22:09:20.937ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105052025-03-25T22:09:20.937ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 93.415091ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
105062025-03-25T22:09:20.939ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105072025-03-25T22:09:20.941ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
105082025-03-25T22:09:20.941ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
105092025-03-25T22:09:20.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
105102025-03-25T22:09:20.942ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
105112025-03-25T22:09:20.942ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
105122025-03-25T22:09:20.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
105132025-03-25T22:09:20.958ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
105142025-03-25T22:09:20.958ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
105152025-03-25T22:09:20.958ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
105162025-03-25T22:09:20.958ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 114.180065ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
105172025-03-25T22:09:20.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
105182025-03-25T22:09:20.961ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105192025-03-25T22:09:20.965ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
105202025-03-25T22:09:20.965ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
105212025-03-25T22:09:20.965ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 120.81645ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
105222025-03-25T22:09:20.965ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
105232025-03-25T22:09:20.982ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105242025-03-25T22:09:20.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105252025-03-25T22:09:20.984ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 140.22079ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
105262025-03-25T22:09:20.985ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105272025-03-25T22:09:20.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105282025-03-25T22:09:20.986ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
105292025-03-25T22:09:20.986ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 141.656725ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
105302025-03-25T22:09:20.986ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
105312025-03-25T22:09:20.986ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
105322025-03-25T22:09:20.986ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 23d93905-7b89-4296-b050-7ff9ae235c15 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
105332025-03-25T22:09:20.986ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
105342025-03-25T22:09:20.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
105352025-03-25T22:09:20.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
105362025-03-25T22:09:20.988ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
105372025-03-25T22:09:20.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
105382025-03-25T22:09:20.990ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105392025-03-25T22:09:20.992ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
105402025-03-25T22:09:20.992ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
105412025-03-25T22:09:20.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
105422025-03-25T22:09:20.992ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105432025-03-25T22:09:20.995ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
105442025-03-25T22:09:20.996ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105452025-03-25T22:09:20.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105462025-03-25T22:09:20.996ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
105472025-03-25T22:09:20.998ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
105482025-03-25T22:09:20.998ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
105492025-03-25T22:09:20.998ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf548718-c4cd-4c73-896d-328b4e74f45e", "content-length": "26", "date": "Tue, 25 Mar 2025 22:09:20 GMT"} })
105502025-03-25T22:09:20.998ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
105512025-03-25T22:09:20.999ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 154.995827ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
105522025-03-25T22:09:21.000ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
105532025-03-25T22:09:21.018ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
105542025-03-25T22:09:21.018ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 174.229863ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
105552025-03-25T22:09:21.018ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
105562025-03-25T22:09:21.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
105572025-03-25T22:09:21.019ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
105582025-03-25T22:09:21.019ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
105592025-03-25T22:09:21.019ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
105602025-03-25T22:09:21.019ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
105612025-03-25T22:09:21.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
105622025-03-25T22:09:21.020ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
105632025-03-25T22:09:21.020ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
105642025-03-25T22:09:21.020ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 176.098487ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
105652025-03-25T22:09:21.020ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105662025-03-25T22:09:21.021ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105672025-03-25T22:09:21.021ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
105682025-03-25T22:09:21.021ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
105692025-03-25T22:09:21.022ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "63788cfc-2315-4914-a172-f845ad3d9e22", "content-length": "26", "date": "Tue, 25 Mar 2025 22:09:20 GMT"} })
105702025-03-25T22:09:21.022ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
105712025-03-25T22:09:21.024ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
105722025-03-25T22:09:21.024ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
105732025-03-25T22:09:21.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
105742025-03-25T22:09:21.024ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
105752025-03-25T22:09:21.026ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
105762025-03-25T22:09:21.026ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
105772025-03-25T22:09:21.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
105782025-03-25T22:09:21.028ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105792025-03-25T22:09:21.029ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
105802025-03-25T22:09:21.029ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 96679ce4-e18c-487b-803a-7b26be55e85c dns_zone_name = oxide.test found_so_far = 0 version = 2
105812025-03-25T22:09:21.029ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
105822025-03-25T22:09:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
105832025-03-25T22:09:21.031ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105842025-03-25T22:09:21.031ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
105852025-03-25T22:09:21.031ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f034aaf6-2037-4cb4-8409-3ab31c15cc28, lookup_type: ById(f034aaf6-2037-4cb4-8409-3ab31c15cc28) } result = Ok(())
105862025-03-25T22:09:21.031ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105872025-03-25T22:09:21.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105882025-03-25T22:09:21.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
105892025-03-25T22:09:21.033ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 189.347698ms iteration = 19 status = 0
105902025-03-25T22:09:21.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
105912025-03-25T22:09:21.034ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
105922025-03-25T22:09:21.034ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105932025-03-25T22:09:21.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
105942025-03-25T22:09:21.035ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 96679ce4-e18c-487b-803a-7b26be55e85c dns_zone_name = oxide.test found_so_far = 1 version = 2
105952025-03-25T22:09:21.035ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
105962025-03-25T22:09:21.035ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-03-25 22:00:22.561696 UTC dns_group = external generation = 2
105972025-03-25T22:09:21.035ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 191.506486ms iteration = 10 status = {"generation":2}
105982025-03-25T22:09:21.037ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
105992025-03-25T22:09:21.037ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
106002025-03-25T22:09:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
106012025-03-25T22:09:21.038ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106022025-03-25T22:09:21.040ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
106032025-03-25T22:09:21.040ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
106042025-03-25T22:09:21.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
106052025-03-25T22:09:21.053ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106062025-03-25T22:09:21.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
106072025-03-25T22:09:21.057ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
106082025-03-25T22:09:21.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
106092025-03-25T22:09:21.059ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:360
106102025-03-25T22:09:21.059ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 215.122298ms iteration = 19 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
106112025-03-25T22:09:21.060ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 23d93905-7b89-4296-b050-7ff9ae235c15 dns_zone_name = control-plane.oxide.internal found_so_far = 52 version = 1
106122025-03-25T22:09:21.060ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
106132025-03-25T22:09:21.060ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-03-25 22:00:21.368103 UTC dns_group = internal generation = 1
106142025-03-25T22:09:21.060ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 216.043474ms iteration = 10 status = {"generation":1}
106152025-03-25T22:09:21.088ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-03-25T22:00:16.382271Z, time_modified: 2025-03-25T22:00:16.382271Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, db_silo: Silo { identity: SiloIdentity { id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-25T22:00:22.501108Z, time_modified: 2025-03-25T22:00:22.501108Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, db_silo: Silo { identity: SiloIdentity { id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-25T22:00:22.501108Z, time_modified: 2025-03-25T22:00:22.501108Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d" }] }) }
106162025-03-25T22:09:21.088ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 243.939042ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"5c35ff8c-21dd-48b9-9751-76bfa681bc38","tls_certs":["0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d"]}},"default_endpoint":{"silo_id":"5c35ff8c-21dd-48b9-9751-76bfa681bc38","tls_certs":["0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
106172025-03-25T22:09:21.093ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
106182025-03-25T22:09:21.093ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 248.903428ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
106192025-03-25T22:09:21.110ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 265.850734ms iteration = 21 status = {"physical_disks_added":0}
106202025-03-25T22:09:21.114ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
106212025-03-25T22:09:21.152ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 zone_address = fd00:1122:3344:101::2
106222025-03-25T22:09:21.152ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
106232025-03-25T22:09:21.152ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ecc764a9-b957-4587-9dad-f0cd85f6f639", "content-length": "26", "date": "Tue, 25 Mar 2025 22:09:20 GMT"} })
106242025-03-25T22:09:21.152ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1184 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
106252025-03-25T22:09:21.154ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
106262025-03-25T22:09:21.186ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
106272025-03-25T22:09:21.283ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 439.275504ms iteration = 19 status = {}
106282025-03-25T22:09:21.297ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
106292025-03-25T22:09:21.297ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
106302025-03-25T22:09:21.297ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5d2f052-49fc-434f-9465-3edeb2a8c81d", "content-length": "372", "date": "Tue, 25 Mar 2025 22:09:21 GMT"} })
106312025-03-25T22:09:21.297ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106322025-03-25T22:09:21.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106332025-03-25T22:09:21.312ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
106342025-03-25T22:09:21.312ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
106352025-03-25T22:09:21.312ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "669f485e-cc73-4aba-ad61-875da2d35073", "date": "Tue, 25 Mar 2025 22:09:21 GMT"} })
106362025-03-25T22:09:21.312ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106372025-03-25T22:09:21.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106382025-03-25T22:09:21.315ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106392025-03-25T22:09:21.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106402025-03-25T22:09:21.316ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
106412025-03-25T22:09:21.316ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e07696b5-cbbf-4f90-a99f-9020649f005d", "content-length": "1", "date": "Tue, 25 Mar 2025 22:09:20 GMT"} })
106422025-03-25T22:09:21.317ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
106432025-03-25T22:09:21.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
106442025-03-25T22:09:21.318ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106452025-03-25T22:09:21.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106462025-03-25T22:09:21.327ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
106472025-03-25T22:09:21.327ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d0dfadb-bd4a-417d-8e83-36a011753a1a", "content-length": "691", "date": "Tue, 25 Mar 2025 22:09:21 GMT"} })
106482025-03-25T22:09:21.327ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
106492025-03-25T22:09:21.327ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
106502025-03-25T22:09:21.327ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
106512025-03-25T22:09:21.329ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 484.804788ms iteration = 19 status = {}
106522025-03-25T22:09:21.329ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 485.393419ms iteration = 19 status = null
106532025-03-25T22:09:21.330ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
106542025-03-25T22:09:21.330ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
106552025-03-25T22:09:21.330ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "20d36a9a-5e2c-4675-9baf-bfbd611e3417", "date": "Tue, 25 Mar 2025 22:09:21 GMT"} })
106562025-03-25T22:09:21.332ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 487.994284ms iteration = 19 status = {}
106572025-03-25T22:09:21.341ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
106582025-03-25T22:09:21.342ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "fac3e751-6717-46f5-93ae-5454eb5d3adf", "date": "Tue, 25 Mar 2025 22:09:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
106592025-03-25T22:09:21.342ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
106602025-03-25T22:09:21.342ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
106612025-03-25T22:09:21.343ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "ae2098ca-d820-4f9a-8726-8a8494d38306", "date": "Tue, 25 Mar 2025 22:09:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
106622025-03-25T22:09:21.343ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
106632025-03-25T22:09:21.343ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "8774757d-86a9-42a8-95b7-4ca9d915ff8c", "date": "Tue, 25 Mar 2025 22:09:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
106642025-03-25T22:09:21.343ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
106652025-03-25T22:09:21.343ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "c7ea8c46-59a1-4304-87d5-9c0489ffb847", "date": "Tue, 25 Mar 2025 22:09:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
106662025-03-25T22:09:21.343ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
106672025-03-25T22:09:21.345ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "4891fcdc-563e-45a5-a408-109119d617f7", "date": "Tue, 25 Mar 2025 22:09:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
106682025-03-25T22:09:21.345ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
106692025-03-25T22:09:21.345ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
106702025-03-25T22:09:21.345ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 501.610082ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
106712025-03-25T22:09:21.346ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
106722025-03-25T22:09:21.347ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 502.682611ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
106732025-03-25T22:09:21.406ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106742025-03-25T22:09:21.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106752025-03-25T22:09:21.407ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a5db250-fa3f-4168-ab16-5c36568c22e2, rack_id: c7210e4b-5a81-4ec8-b8fe-816a9508dc74, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(6d5dda50-e3c4-4853-9bfa-a66b447ab351) } rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
106762025-03-25T22:09:21.407ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106772025-03-25T22:09:21.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106782025-03-25T22:09:21.415ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
106792025-03-25T22:09:21.415ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "75c2deb5-f16d-43e2-bb64-f21c8e3634d6", "content-length": "134", "date": "Tue, 25 Mar 2025 22:09:21 GMT"} })
106802025-03-25T22:09:21.416ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
106812025-03-25T22:09:21.416ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 6d5dda50-e3c4-4853-9bfa-a66b447ab351
106822025-03-25T22:09:21.416ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
106832025-03-25T22:09:21.416ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
106842025-03-25T22:09:21.416ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
106852025-03-25T22:09:21.416ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
106862025-03-25T22:09:21.416ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
106872025-03-25T22:09:21.416ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
106882025-03-25T22:09:21.416ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
106892025-03-25T22:09:21.416ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
106902025-03-25T22:09:21.416ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
106912025-03-25T22:09:21.416ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106922025-03-25T22:09:21.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106932025-03-25T22:09:21.418ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
106942025-03-25T22:09:21.418ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e06c11d-70b6-4240-aade-ac8040255507", "content-length": "2", "date": "Tue, 25 Mar 2025 22:09:21 GMT"} })
106952025-03-25T22:09:21.418ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
106962025-03-25T22:09:21.418ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "14c33b81-fd2e-4b39-a39d-52658afecc50", "content-length": "52", "date": "Tue, 25 Mar 2025 22:09:21 GMT"} })
106972025-03-25T22:09:21.418ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
106982025-03-25T22:09:21.418ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
106992025-03-25T22:09:21.519ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "94ed0214-6cdd-4632-bae5-ccd1ab4820dc", "date": "Tue, 25 Mar 2025 22:09:21 GMT"} })
107002025-03-25T22:09:21.519ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch = Switch0
107012025-03-25T22:09:21.519ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
107022025-03-25T22:09:21.519ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "966b4ae7-f67f-41c1-b9fb-e992972c7f1a", "content-length": "682", "date": "Tue, 25 Mar 2025 22:09:21 GMT"} })
107032025-03-25T22:09:21.519ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107042025-03-25T22:09:21.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107052025-03-25T22:09:21.523ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107062025-03-25T22:09:21.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107072025-03-25T22:09:21.526ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107082025-03-25T22:09:21.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107092025-03-25T22:09:21.528ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107102025-03-25T22:09:21.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107112025-03-25T22:09:21.536ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 691.873526ms iteration = 19 status = {}
107122025-03-25T22:09:21.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8236d8b4-4267-4a38-9d8f-aac7eea3e6c1 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107132025-03-25T22:09:21.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8236d8b4-4267-4a38-9d8f-aac7eea3e6c1 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107142025-03-25T22:09:21.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2048 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8236d8b4-4267-4a38-9d8f-aac7eea3e6c1 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107152025-03-25T22:09:22.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a76d5906-2f5d-4bdd-ac23-4d5619e266ea roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107162025-03-25T22:09:22.563ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a76d5906-2f5d-4bdd-ac23-4d5619e266ea resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107172025-03-25T22:09:22.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2067 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a76d5906-2f5d-4bdd-ac23-4d5619e266ea response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107182025-03-25T22:09:23.584ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 9ca4b2cb-b986-498a-9f0e-819b5b170558 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107192025-03-25T22:09:23.584ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 9ca4b2cb-b986-498a-9f0e-819b5b170558 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107202025-03-25T22:09:23.586ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2216 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 9ca4b2cb-b986-498a-9f0e-819b5b170558 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107212025-03-25T22:09:24.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ff78b3ad-a3be-4ea7-a3cb-a78fa5146441 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107222025-03-25T22:09:24.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ff78b3ad-a3be-4ea7-a3cb-a78fa5146441 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107232025-03-25T22:09:24.608ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2273 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ff78b3ad-a3be-4ea7-a3cb-a78fa5146441 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107242025-03-25T22:09:25.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b16d6615-6f79-4d2c-b0f4-2febd0dcca72 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107252025-03-25T22:09:25.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b16d6615-6f79-4d2c-b0f4-2febd0dcca72 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107262025-03-25T22:09:25.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2004 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b16d6615-6f79-4d2c-b0f4-2febd0dcca72 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107272025-03-25T22:09:26.651ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1d5111bd-6609-456a-b3ef-31a741c68f2c roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107282025-03-25T22:09:26.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1d5111bd-6609-456a-b3ef-31a741c68f2c resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107292025-03-25T22:09:26.653ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2166 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1d5111bd-6609-456a-b3ef-31a741c68f2c response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107302025-03-25T22:09:27.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 746a6857-e35b-4b45-b0c6-9fad0e99fe6d roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107312025-03-25T22:09:27.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 746a6857-e35b-4b45-b0c6-9fad0e99fe6d resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107322025-03-25T22:09:27.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2414 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 746a6857-e35b-4b45-b0c6-9fad0e99fe6d response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107332025-03-25T22:09:28.574ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 615 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = 856e7e04-4da8-456f-b422-1e23b016a87d response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
107342025-03-25T22:09:28.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8af5b51c-3995-41a6-9822-36eebd1347e4 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107352025-03-25T22:09:28.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8af5b51c-3995-41a6-9822-36eebd1347e4 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107362025-03-25T22:09:28.698ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2318 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8af5b51c-3995-41a6-9822-36eebd1347e4 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107372025-03-25T22:09:29.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 63c747e3-7b05-47fb-8012-072eca75961b roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107382025-03-25T22:09:29.719ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 63c747e3-7b05-47fb-8012-072eca75961b resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107392025-03-25T22:09:29.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2353 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 63c747e3-7b05-47fb-8012-072eca75961b response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107402025-03-25T22:09:30.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f4d1d16d-b3a9-4fa7-ad51-1d1735f86361 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107412025-03-25T22:09:30.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f4d1d16d-b3a9-4fa7-ad51-1d1735f86361 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107422025-03-25T22:09:30.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1556 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f4d1d16d-b3a9-4fa7-ad51-1d1735f86361 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107432025-03-25T22:09:30.844ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
107442025-03-25T22:09:30.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107452025-03-25T22:09:30.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107462025-03-25T22:09:30.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
107472025-03-25T22:09:30.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
107482025-03-25T22:09:30.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
107492025-03-25T22:09:30.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107502025-03-25T22:09:30.846ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
107512025-03-25T22:09:30.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
107522025-03-25T22:09:30.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
107532025-03-25T22:09:30.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107542025-03-25T22:09:30.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107552025-03-25T22:09:30.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107562025-03-25T22:09:30.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107572025-03-25T22:09:30.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107582025-03-25T22:09:30.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
107592025-03-25T22:09:30.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107602025-03-25T22:09:30.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107612025-03-25T22:09:30.863ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
107622025-03-25T22:09:30.863ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.544251ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
107632025-03-25T22:09:30.877ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.044697ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
107642025-03-25T22:09:31.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a4e17d28-a0de-4e85-b6fc-8601a720831d roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107652025-03-25T22:09:31.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a4e17d28-a0de-4e85-b6fc-8601a720831d resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107662025-03-25T22:09:31.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1843 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a4e17d28-a0de-4e85-b6fc-8601a720831d response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107672025-03-25T22:09:32.783ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c121fd44-f83b-448f-992c-f7eed610f25a roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107682025-03-25T22:09:32.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c121fd44-f83b-448f-992c-f7eed610f25a resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107692025-03-25T22:09:32.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2460 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c121fd44-f83b-448f-992c-f7eed610f25a response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107702025-03-25T22:09:33.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ec024068-aa37-4365-83fd-54c24a01f4e4 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107712025-03-25T22:09:33.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ec024068-aa37-4365-83fd-54c24a01f4e4 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107722025-03-25T22:09:33.807ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2192 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ec024068-aa37-4365-83fd-54c24a01f4e4 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107732025-03-25T22:09:34.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6d74108e-1b3a-4e2c-992d-c2139920fc14 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107742025-03-25T22:09:34.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6d74108e-1b3a-4e2c-992d-c2139920fc14 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107752025-03-25T22:09:34.829ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1631 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6d74108e-1b3a-4e2c-992d-c2139920fc14 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107762025-03-25T22:09:35.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d276e33c-8c2a-492c-a927-706d9002c708 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107772025-03-25T22:09:35.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d276e33c-8c2a-492c-a927-706d9002c708 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107782025-03-25T22:09:35.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2141 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d276e33c-8c2a-492c-a927-706d9002c708 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107792025-03-25T22:09:36.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 19511765-3cc5-424f-8427-f9d3c3046f19 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107802025-03-25T22:09:36.871ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 19511765-3cc5-424f-8427-f9d3c3046f19 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107812025-03-25T22:09:36.873ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2248 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 19511765-3cc5-424f-8427-f9d3c3046f19 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107822025-03-25T22:09:37.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3fcaf0b8-b83b-4ebb-9192-13281c11cf69 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107832025-03-25T22:09:37.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3fcaf0b8-b83b-4ebb-9192-13281c11cf69 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107842025-03-25T22:09:37.895ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2461 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3fcaf0b8-b83b-4ebb-9192-13281c11cf69 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107852025-03-25T22:09:38.573ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 517 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = 7ed52acd-099d-4884-a935-7ea1f32a75f5 response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
107862025-03-25T22:09:38.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c3354eed-ebb1-498d-b937-c91fb47cdc2e roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107872025-03-25T22:09:38.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c3354eed-ebb1-498d-b937-c91fb47cdc2e resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107882025-03-25T22:09:38.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2369 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c3354eed-ebb1-498d-b937-c91fb47cdc2e response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107892025-03-25T22:09:39.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 848c17ce-9b7d-413d-884c-aac4c63795e7 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107902025-03-25T22:09:39.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 848c17ce-9b7d-413d-884c-aac4c63795e7 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107912025-03-25T22:09:39.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1930 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 848c17ce-9b7d-413d-884c-aac4c63795e7 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
107922025-03-25T22:09:40.844ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
107932025-03-25T22:09:40.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107942025-03-25T22:09:40.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107952025-03-25T22:09:40.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
107962025-03-25T22:09:40.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
107972025-03-25T22:09:40.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
107982025-03-25T22:09:40.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107992025-03-25T22:09:40.846ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
108002025-03-25T22:09:40.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
108012025-03-25T22:09:40.848ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.199814ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
108022025-03-25T22:09:40.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
108032025-03-25T22:09:40.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108042025-03-25T22:09:40.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108052025-03-25T22:09:40.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108062025-03-25T22:09:40.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108072025-03-25T22:09:40.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108082025-03-25T22:09:40.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
108092025-03-25T22:09:40.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108102025-03-25T22:09:40.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108112025-03-25T22:09:40.862ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
108122025-03-25T22:09:40.862ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.518513ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
108132025-03-25T22:09:40.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7d1d4518-d51d-47fa-b615-ae495ca163ec roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
108142025-03-25T22:09:40.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7d1d4518-d51d-47fa-b615-ae495ca163ec resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
108152025-03-25T22:09:40.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1979 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7d1d4518-d51d-47fa-b615-ae495ca163ec response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
108162025-03-25T22:09:41.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f7163e56-c4d0-43af-aefe-2f0c92aa3d5b roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
108172025-03-25T22:09:41.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f7163e56-c4d0-43af-aefe-2f0c92aa3d5b resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
108182025-03-25T22:09:41.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1954 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f7163e56-c4d0-43af-aefe-2f0c92aa3d5b response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
108192025-03-25T22:09:43.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6b010230-01db-4799-9761-d4cceeeafb78 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
108202025-03-25T22:09:43.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6b010230-01db-4799-9761-d4cceeeafb78 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
108212025-03-25T22:09:43.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1801 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6b010230-01db-4799-9761-d4cceeeafb78 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
108222025-03-25T22:09:44.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4288fedc-f13a-439e-808a-3e6b8698eb93 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
108232025-03-25T22:09:44.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4288fedc-f13a-439e-808a-3e6b8698eb93 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
108242025-03-25T22:09:44.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1733 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4288fedc-f13a-439e-808a-3e6b8698eb93 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
108252025-03-25T22:09:45.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0fe7a782-d5e2-4b96-9ea1-9e4cff2463cb roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
108262025-03-25T22:09:45.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0fe7a782-d5e2-4b96-9ea1-9e4cff2463cb resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
108272025-03-25T22:09:45.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2519 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0fe7a782-d5e2-4b96-9ea1-9e4cff2463cb response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
108282025-03-25T22:09:46.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 420255e4-74f5-4c51-bbbc-5733e2b6e8dc roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
108292025-03-25T22:09:46.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 420255e4-74f5-4c51-bbbc-5733e2b6e8dc resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
108302025-03-25T22:09:46.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2367 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 420255e4-74f5-4c51-bbbc-5733e2b6e8dc response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
108312025-03-25T22:09:47.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c540ac34-508e-4879-860e-58200357cad4 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
108322025-03-25T22:09:47.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c540ac34-508e-4879-860e-58200357cad4 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
108332025-03-25T22:09:47.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2176 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c540ac34-508e-4879-860e-58200357cad4 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
108342025-03-25T22:09:48.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 66b1bfbc-399a-49c5-a4f9-7f3ec89985cf roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
108352025-03-25T22:09:48.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 66b1bfbc-399a-49c5-a4f9-7f3ec89985cf resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
108362025-03-25T22:09:48.117ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2038 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 66b1bfbc-399a-49c5-a4f9-7f3ec89985cf response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
108372025-03-25T22:09:48.573ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 464 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = 28984b44-1329-43bf-93ef-cdf3b70a6082 response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
108382025-03-25T22:09:49.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = df05bcef-3639-49d9-af49-8eddd80eea44 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
108392025-03-25T22:09:49.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = df05bcef-3639-49d9-af49-8eddd80eea44 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
108402025-03-25T22:09:49.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2127 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = df05bcef-3639-49d9-af49-8eddd80eea44 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
108412025-03-25T22:09:50.158ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 23deb238-4969-495d-8e90-301a741bfc18 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
108422025-03-25T22:09:50.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 23deb238-4969-495d-8e90-301a741bfc18 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
108432025-03-25T22:09:50.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2151 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 23deb238-4969-495d-8e90-301a741bfc18 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
108442025-03-25T22:09:50.844ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
108452025-03-25T22:09:50.844ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
108462025-03-25T22:09:50.844ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
108472025-03-25T22:09:50.844ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
108482025-03-25T22:09:50.844ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
108492025-03-25T22:09:50.844ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108502025-03-25T22:09:50.844ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
108512025-03-25T22:09:50.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
108522025-03-25T22:09:50.844ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
108532025-03-25T22:09:50.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
108542025-03-25T22:09:50.844ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108552025-03-25T22:09:50.844ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 20 reason = Timeout
108562025-03-25T22:09:50.844ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
108572025-03-25T22:09:50.844ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
108582025-03-25T22:09:50.844ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
108592025-03-25T22:09:50.844ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
108602025-03-25T22:09:50.844ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
108612025-03-25T22:09:50.844ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
108622025-03-25T22:09:50.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108632025-03-25T22:09:50.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
108642025-03-25T22:09:50.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
108652025-03-25T22:09:50.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
108662025-03-25T22:09:50.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
108672025-03-25T22:09:50.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
108682025-03-25T22:09:50.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
108692025-03-25T22:09:50.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
108702025-03-25T22:09:50.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
108712025-03-25T22:09:50.844ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
108722025-03-25T22:09:50.844ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
108732025-03-25T22:09:50.844ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108742025-03-25T22:09:50.844ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 20 reason = Timeout
108752025-03-25T22:09:50.844ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
108762025-03-25T22:09:50.844ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
108772025-03-25T22:09:50.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
108782025-03-25T22:09:50.844ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
108792025-03-25T22:09:50.844ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
108802025-03-25T22:09:50.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
108812025-03-25T22:09:50.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
108822025-03-25T22:09:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
108832025-03-25T22:09:50.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
108842025-03-25T22:09:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108852025-03-25T22:09:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108862025-03-25T22:09:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
108872025-03-25T22:09:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108882025-03-25T22:09:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
108892025-03-25T22:09:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
108902025-03-25T22:09:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
108912025-03-25T22:09:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
108922025-03-25T22:09:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108932025-03-25T22:09:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
108942025-03-25T22:09:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
108952025-03-25T22:09:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
108962025-03-25T22:09:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
108972025-03-25T22:09:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
108982025-03-25T22:09:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
108992025-03-25T22:09:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
109002025-03-25T22:09:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109012025-03-25T22:09:50.847ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.763378ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
109022025-03-25T22:09:50.847ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109032025-03-25T22:09:50.847ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6744, tv_nsec: 182917234 } })
109042025-03-25T22:09:50.847ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1171
109052025-03-25T22:09:50.847ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
109062025-03-25T22:09:50.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109072025-03-25T22:09:50.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
109082025-03-25T22:09:50.848ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109092025-03-25T22:09:50.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
109102025-03-25T22:09:50.850ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
109112025-03-25T22:09:50.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
109122025-03-25T22:09:50.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
109132025-03-25T22:09:50.850ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
109142025-03-25T22:09:50.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
109152025-03-25T22:09:50.851ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
109162025-03-25T22:09:50.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109172025-03-25T22:09:50.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109182025-03-25T22:09:50.852ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109192025-03-25T22:09:50.853ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109202025-03-25T22:09:50.853ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.822624ms iteration = 20 status = {"errors":[],"finish_invoked_ok":[]}
109212025-03-25T22:09:50.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
109222025-03-25T22:09:50.854ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
109232025-03-25T22:09:50.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
109242025-03-25T22:09:50.855ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
109252025-03-25T22:09:50.855ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109262025-03-25T22:09:50.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109272025-03-25T22:09:50.856ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6744, tv_nsec: 191957072 } })
109282025-03-25T22:09:50.856ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
109292025-03-25T22:09:50.856ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1171
109302025-03-25T22:09:50.856ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109312025-03-25T22:09:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
109322025-03-25T22:09:50.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
109332025-03-25T22:09:50.858ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
109342025-03-25T22:09:50.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
109352025-03-25T22:09:50.858ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
109362025-03-25T22:09:50.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
109372025-03-25T22:09:50.858ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 14.359851ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
109382025-03-25T22:09:50.860ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
109392025-03-25T22:09:50.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
109402025-03-25T22:09:50.860ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
109412025-03-25T22:09:50.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
109422025-03-25T22:09:50.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109432025-03-25T22:09:50.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109442025-03-25T22:09:50.861ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109452025-03-25T22:09:50.864ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
109462025-03-25T22:09:50.864ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109472025-03-25T22:09:50.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109482025-03-25T22:09:50.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109492025-03-25T22:09:50.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
109502025-03-25T22:09:50.870ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109512025-03-25T22:09:50.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109522025-03-25T22:09:50.877ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
109532025-03-25T22:09:50.877ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 32.520048ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
109542025-03-25T22:09:50.885ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
109552025-03-25T22:09:50.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
109562025-03-25T22:09:50.890ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
109572025-03-25T22:09:50.890ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
109582025-03-25T22:09:50.890ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
109592025-03-25T22:09:50.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
109602025-03-25T22:09:50.891ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109612025-03-25T22:09:50.893ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
109622025-03-25T22:09:50.893ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109632025-03-25T22:09:50.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109642025-03-25T22:09:50.895ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 50.470352ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
109652025-03-25T22:09:50.895ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6744, tv_nsec: 231494332 } })
109662025-03-25T22:09:50.896ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1171 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
109672025-03-25T22:09:50.896ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
109682025-03-25T22:09:50.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
109692025-03-25T22:09:50.897ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 52.452346ms iteration = 20 status = {"errors":[],"requests_created_ok":[]}
109702025-03-25T22:09:50.898ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
109712025-03-25T22:09:50.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
109722025-03-25T22:09:50.899ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 54.594224ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
109732025-03-25T22:09:50.899ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
109742025-03-25T22:09:50.899ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
109752025-03-25T22:09:50.899ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3ccb7e6e-71e2-4aab-a584-0b8bf6394dcf", "content-length": "26", "date": "Tue, 25 Mar 2025 22:09:49 GMT"} })
109762025-03-25T22:09:50.899ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
109772025-03-25T22:09:50.905ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
109782025-03-25T22:09:50.909ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
109792025-03-25T22:09:50.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
109802025-03-25T22:09:50.912ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109812025-03-25T22:09:50.914ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109822025-03-25T22:09:50.914ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
109832025-03-25T22:09:50.914ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
109842025-03-25T22:09:50.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
109852025-03-25T22:09:50.917ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
109862025-03-25T22:09:50.917ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
109872025-03-25T22:09:50.917ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "74b84bd4-2bab-4f82-8554-797cc751d002", "content-length": "26", "date": "Tue, 25 Mar 2025 22:09:49 GMT"} })
109882025-03-25T22:09:50.917ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
109892025-03-25T22:09:50.917ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
109902025-03-25T22:09:50.917ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
109912025-03-25T22:09:50.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
109922025-03-25T22:09:50.918ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
109932025-03-25T22:09:50.919ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 75.079912ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
109942025-03-25T22:09:50.920ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
109952025-03-25T22:09:50.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
109962025-03-25T22:09:50.924ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
109972025-03-25T22:09:50.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
109982025-03-25T22:09:50.930ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109992025-03-25T22:09:50.932ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110002025-03-25T22:09:50.934ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f034aaf6-2037-4cb4-8409-3ab31c15cc28, lookup_type: ById(f034aaf6-2037-4cb4-8409-3ab31c15cc28) } result = Ok(())
110012025-03-25T22:09:50.934ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
110022025-03-25T22:09:50.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
110032025-03-25T22:09:50.934ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
110042025-03-25T22:09:50.934ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
110052025-03-25T22:09:50.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
110062025-03-25T22:09:50.936ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 91.869194ms iteration = 20 status = 0
110072025-03-25T22:09:50.937ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
110082025-03-25T22:09:50.937ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 92.392144ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
110092025-03-25T22:09:50.950ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
110102025-03-25T22:09:50.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
110112025-03-25T22:09:50.952ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 107.871574ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
110122025-03-25T22:09:50.954ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
110132025-03-25T22:09:50.954ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
110142025-03-25T22:09:50.954ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
110152025-03-25T22:09:50.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
110162025-03-25T22:09:50.968ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110172025-03-25T22:09:50.968ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:360
110182025-03-25T22:09:50.969ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 124.562386ms iteration = 20 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
110192025-03-25T22:09:50.969ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
110202025-03-25T22:09:50.969ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
110212025-03-25T22:09:50.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
110222025-03-25T22:09:50.991ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 147.241162ms iteration = 22 status = {"physical_disks_added":0}
110232025-03-25T22:09:50.994ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
110242025-03-25T22:09:50.994ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d92c53a4-37a6-4213-815a-1f145dbb896a", "content-length": "1", "date": "Tue, 25 Mar 2025 22:09:50 GMT"} })
110252025-03-25T22:09:50.995ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 zone_address = fd00:1122:3344:101::2
110262025-03-25T22:09:50.995ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
110272025-03-25T22:09:50.995ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "83f6f710-af91-40af-9e93-234923869f0b", "content-length": "26", "date": "Tue, 25 Mar 2025 22:09:50 GMT"} })
110282025-03-25T22:09:50.995ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1184 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
110292025-03-25T22:09:50.996ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
110302025-03-25T22:09:50.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
110312025-03-25T22:09:50.997ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
110322025-03-25T22:09:50.998ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 154.365866ms iteration = 20 status = null
110332025-03-25T22:09:50.999ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 155.141681ms iteration = 20 status = {}
110342025-03-25T22:09:51.007ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
110352025-03-25T22:09:51.007ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
110362025-03-25T22:09:51.007ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 163.19401ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
110372025-03-25T22:09:51.035ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
110382025-03-25T22:09:51.035ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
110392025-03-25T22:09:51.035ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "44ef233d-9c0b-44ea-b3ab-ac233714376b", "content-length": "372", "date": "Tue, 25 Mar 2025 22:09:51 GMT"} })
110402025-03-25T22:09:51.035ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110412025-03-25T22:09:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110422025-03-25T22:09:51.103ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
110432025-03-25T22:09:51.103ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
110442025-03-25T22:09:51.104ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "aac19f64-e860-4e1f-a797-819b576009b3", "date": "Tue, 25 Mar 2025 22:09:51 GMT"} })
110452025-03-25T22:09:51.104ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110462025-03-25T22:09:51.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110472025-03-25T22:09:51.106ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110482025-03-25T22:09:51.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110492025-03-25T22:09:51.108ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
110502025-03-25T22:09:51.108ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0c4460c-a9ba-4098-b4a1-c15918ddd39b", "content-length": "691", "date": "Tue, 25 Mar 2025 22:09:51 GMT"} })
110512025-03-25T22:09:51.109ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
110522025-03-25T22:09:51.109ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
110532025-03-25T22:09:51.109ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
110542025-03-25T22:09:51.109ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110552025-03-25T22:09:51.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110562025-03-25T22:09:51.110ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 265.822263ms iteration = 20 status = {}
110572025-03-25T22:09:51.111ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
110582025-03-25T22:09:51.112ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
110592025-03-25T22:09:51.112ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9bce3da7-c812-4ed2-a2ef-4919d6b211e6", "date": "Tue, 25 Mar 2025 22:09:51 GMT"} })
110602025-03-25T22:09:51.113ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 269.160302ms iteration = 20 status = {}
110612025-03-25T22:09:51.144ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110622025-03-25T22:09:51.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110632025-03-25T22:09:51.146ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a5db250-fa3f-4168-ab16-5c36568c22e2, rack_id: c7210e4b-5a81-4ec8-b8fe-816a9508dc74, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(6d5dda50-e3c4-4853-9bfa-a66b447ab351) } rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
110642025-03-25T22:09:51.146ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110652025-03-25T22:09:51.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110662025-03-25T22:09:51.155ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
110672025-03-25T22:09:51.156ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d605ed8e-b16c-4922-b911-8f816a074db4", "content-length": "134", "date": "Tue, 25 Mar 2025 22:09:50 GMT"} })
110682025-03-25T22:09:51.156ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
110692025-03-25T22:09:51.156ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 6d5dda50-e3c4-4853-9bfa-a66b447ab351
110702025-03-25T22:09:51.156ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
110712025-03-25T22:09:51.156ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
110722025-03-25T22:09:51.156ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
110732025-03-25T22:09:51.156ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
110742025-03-25T22:09:51.156ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
110752025-03-25T22:09:51.156ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
110762025-03-25T22:09:51.156ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
110772025-03-25T22:09:51.156ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
110782025-03-25T22:09:51.157ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
110792025-03-25T22:09:51.157ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110802025-03-25T22:09:51.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110812025-03-25T22:09:51.158ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
110822025-03-25T22:09:51.159ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e6c4c2a3-a6b1-410c-9121-8a2d4442449f", "content-length": "2", "date": "Tue, 25 Mar 2025 22:09:50 GMT"} })
110832025-03-25T22:09:51.159ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
110842025-03-25T22:09:51.159ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8665c4d6-9103-41c7-a3c5-fcc41d7e23ad", "content-length": "52", "date": "Tue, 25 Mar 2025 22:09:50 GMT"} })
110852025-03-25T22:09:51.159ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
110862025-03-25T22:09:51.159ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
110872025-03-25T22:09:51.271ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9f69ef83-1151-479a-a2fc-18ceaef65d5e", "date": "Tue, 25 Mar 2025 22:09:51 GMT"} })
110882025-03-25T22:09:51.271ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch = Switch0
110892025-03-25T22:09:51.271ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
110902025-03-25T22:09:51.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1c727588-9a47-4811-b92e-9c6a9dd5b62b roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
110912025-03-25T22:09:51.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1c727588-9a47-4811-b92e-9c6a9dd5b62b resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
110922025-03-25T22:09:51.272ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e91f385-0022-4133-8c3c-7d85bc4d38eb", "content-length": "682", "date": "Tue, 25 Mar 2025 22:09:51 GMT"} })
110932025-03-25T22:09:51.272ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110942025-03-25T22:09:51.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110952025-03-25T22:09:51.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1992 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1c727588-9a47-4811-b92e-9c6a9dd5b62b response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
110962025-03-25T22:09:51.277ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110972025-03-25T22:09:51.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110982025-03-25T22:09:51.286ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110992025-03-25T22:09:51.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111002025-03-25T22:09:51.289ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111012025-03-25T22:09:51.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111022025-03-25T22:09:51.298ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 453.586164ms iteration = 20 status = {}
111032025-03-25T22:09:52.301ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ab204f79-2f3f-446f-a12b-af31b1a004ea roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111042025-03-25T22:09:52.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ab204f79-2f3f-446f-a12b-af31b1a004ea resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111052025-03-25T22:09:52.303ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1981 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ab204f79-2f3f-446f-a12b-af31b1a004ea response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111062025-03-25T22:09:53.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 30b834a4-9bb4-4d1a-8fed-fffd4d70b16e roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111072025-03-25T22:09:53.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 30b834a4-9bb4-4d1a-8fed-fffd4d70b16e resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111082025-03-25T22:09:53.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2455 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 30b834a4-9bb4-4d1a-8fed-fffd4d70b16e response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111092025-03-25T22:09:54.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 52a4ae65-d2bc-4eda-94c0-f0a73d4c4f98 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111102025-03-25T22:09:54.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 52a4ae65-d2bc-4eda-94c0-f0a73d4c4f98 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111112025-03-25T22:09:54.347ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1952 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 52a4ae65-d2bc-4eda-94c0-f0a73d4c4f98 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111122025-03-25T22:09:55.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1e8e6089-89c8-449d-bbe5-a8190e6f6dc0 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111132025-03-25T22:09:55.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1e8e6089-89c8-449d-bbe5-a8190e6f6dc0 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111142025-03-25T22:09:55.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1860 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1e8e6089-89c8-449d-bbe5-a8190e6f6dc0 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111152025-03-25T22:09:56.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 85fe8265-7818-4571-8109-314365bf87cc roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111162025-03-25T22:09:56.390ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 85fe8265-7818-4571-8109-314365bf87cc resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111172025-03-25T22:09:56.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2007 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 85fe8265-7818-4571-8109-314365bf87cc response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111182025-03-25T22:09:57.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f4b6aabe-24f1-46fe-bb2e-3c25cd0dfea4 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111192025-03-25T22:09:57.412ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f4b6aabe-24f1-46fe-bb2e-3c25cd0dfea4 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111202025-03-25T22:09:57.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2477 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f4b6aabe-24f1-46fe-bb2e-3c25cd0dfea4 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111212025-03-25T22:09:58.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 49bd9f11-d153-4798-94b2-317f0728ec6c roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111222025-03-25T22:09:58.434ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 49bd9f11-d153-4798-94b2-317f0728ec6c resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111232025-03-25T22:09:58.436ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2306 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 49bd9f11-d153-4798-94b2-317f0728ec6c response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111242025-03-25T22:09:58.566ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:39424
111252025-03-25T22:09:58.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39424 req_id = b4c7964f-88d7-4d12-beea-268c630d6ac9 roles = RoleSet { roles: {} } uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
111262025-03-25T22:09:58.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39424 req_id = b4c7964f-88d7-4d12-beea-268c630d6ac9 resource = Database result = Ok(()) uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
111272025-03-25T22:09:58.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2499 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39424 req_id = b4c7964f-88d7-4d12-beea-268c630d6ac9 response_code = 200 uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
111282025-03-25T22:09:58.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39424 req_id = 120d0d48-3f7c-424a-8c9c-87127447be05 roles = RoleSet { roles: {} } uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
111292025-03-25T22:09:58.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39424 req_id = 120d0d48-3f7c-424a-8c9c-87127447be05 resource = Database result = Ok(()) uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
111302025-03-25T22:09:58.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2030 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39424 req_id = 120d0d48-3f7c-424a-8c9c-87127447be05 response_code = 200 uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
111312025-03-25T22:09:58.573ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 602 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = bfd25c0a-f8f4-4670-8504-7abae2fc8ba1 response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
111322025-03-25T22:09:59.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c76f680a-6ffe-44d8-bb4a-ea6114f14600 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111332025-03-25T22:09:59.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c76f680a-6ffe-44d8-bb4a-ea6114f14600 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111342025-03-25T22:09:59.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2695 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c76f680a-6ffe-44d8-bb4a-ea6114f14600 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111352025-03-25T22:10:00.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6173225a-ff7c-45cb-b183-b71126fafb07 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111362025-03-25T22:10:00.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6173225a-ff7c-45cb-b183-b71126fafb07 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111372025-03-25T22:10:00.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2113 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6173225a-ff7c-45cb-b183-b71126fafb07 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111382025-03-25T22:10:00.844ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
111392025-03-25T22:10:00.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111402025-03-25T22:10:00.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111412025-03-25T22:10:00.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
111422025-03-25T22:10:00.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
111432025-03-25T22:10:00.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111442025-03-25T22:10:00.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111452025-03-25T22:10:00.846ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
111462025-03-25T22:10:00.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111472025-03-25T22:10:00.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
111482025-03-25T22:10:00.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111492025-03-25T22:10:00.849ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.462818ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
111502025-03-25T22:10:00.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111512025-03-25T22:10:00.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111522025-03-25T22:10:00.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111532025-03-25T22:10:00.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111542025-03-25T22:10:00.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
111552025-03-25T22:10:00.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111562025-03-25T22:10:00.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111572025-03-25T22:10:00.861ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
111582025-03-25T22:10:00.861ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.593967ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
111592025-03-25T22:10:01.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2ef166e5-f7ee-4902-be31-bbef06fd1db4 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111602025-03-25T22:10:01.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2ef166e5-f7ee-4902-be31-bbef06fd1db4 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111612025-03-25T22:10:01.502ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2299 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2ef166e5-f7ee-4902-be31-bbef06fd1db4 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111622025-03-25T22:10:02.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 094d02ea-4790-4324-baeb-633060a0eb13 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111632025-03-25T22:10:02.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 094d02ea-4790-4324-baeb-633060a0eb13 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111642025-03-25T22:10:02.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1904 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 094d02ea-4790-4324-baeb-633060a0eb13 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111652025-03-25T22:10:03.544ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c10cf784-5afc-4bad-819a-74ae17a5d234 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111662025-03-25T22:10:03.544ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c10cf784-5afc-4bad-819a-74ae17a5d234 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111672025-03-25T22:10:03.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2582 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c10cf784-5afc-4bad-819a-74ae17a5d234 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111682025-03-25T22:10:04.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 743794a5-9b89-4359-9452-15ee26ae0c28 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111692025-03-25T22:10:04.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 743794a5-9b89-4359-9452-15ee26ae0c28 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111702025-03-25T22:10:04.569ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2108 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 743794a5-9b89-4359-9452-15ee26ae0c28 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111712025-03-25T22:10:05.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 736d872c-9f1b-4964-ad85-85e90f2e0cec roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111722025-03-25T22:10:05.589ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 736d872c-9f1b-4964-ad85-85e90f2e0cec resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111732025-03-25T22:10:05.591ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2375 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 736d872c-9f1b-4964-ad85-85e90f2e0cec response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111742025-03-25T22:10:06.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 27b8b484-320f-4cc2-93b3-a6e814396b78 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111752025-03-25T22:10:06.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 27b8b484-320f-4cc2-93b3-a6e814396b78 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111762025-03-25T22:10:06.613ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2405 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 27b8b484-320f-4cc2-93b3-a6e814396b78 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111772025-03-25T22:10:07.634ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a8ac6f59-30e2-4925-bd60-a1f4f9808355 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111782025-03-25T22:10:07.634ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a8ac6f59-30e2-4925-bd60-a1f4f9808355 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111792025-03-25T22:10:07.636ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2107 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a8ac6f59-30e2-4925-bd60-a1f4f9808355 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111802025-03-25T22:10:08.574ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 908 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = 4a8e7a2c-93b2-43a8-92cd-a424ab1a1019 response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
111812025-03-25T22:10:08.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = efb1b57c-adee-426b-89ed-2dfcdf2aad26 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111822025-03-25T22:10:08.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = efb1b57c-adee-426b-89ed-2dfcdf2aad26 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111832025-03-25T22:10:08.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2008 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = efb1b57c-adee-426b-89ed-2dfcdf2aad26 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111842025-03-25T22:10:09.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = eec60d50-1059-4b2f-8a2f-c209d36e1276 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111852025-03-25T22:10:09.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = eec60d50-1059-4b2f-8a2f-c209d36e1276 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111862025-03-25T22:10:09.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2596 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = eec60d50-1059-4b2f-8a2f-c209d36e1276 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111872025-03-25T22:10:10.699ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 831edfef-f23d-4417-9b57-96f8d5fe303e roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111882025-03-25T22:10:10.699ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 831edfef-f23d-4417-9b57-96f8d5fe303e resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111892025-03-25T22:10:10.701ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2265 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 831edfef-f23d-4417-9b57-96f8d5fe303e response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
111902025-03-25T22:10:10.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
111912025-03-25T22:10:10.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111922025-03-25T22:10:10.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111932025-03-25T22:10:10.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
111942025-03-25T22:10:10.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
111952025-03-25T22:10:10.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111962025-03-25T22:10:10.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111972025-03-25T22:10:10.846ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
111982025-03-25T22:10:10.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111992025-03-25T22:10:10.848ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.428291ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
112002025-03-25T22:10:10.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
112012025-03-25T22:10:10.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112022025-03-25T22:10:10.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112032025-03-25T22:10:10.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112042025-03-25T22:10:10.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112052025-03-25T22:10:10.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112062025-03-25T22:10:10.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
112072025-03-25T22:10:10.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112082025-03-25T22:10:10.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112092025-03-25T22:10:10.861ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
112102025-03-25T22:10:10.861ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.161047ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
112112025-03-25T22:10:11.720ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 661da6c1-fd23-421a-b171-2cacf51a48eb roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
112122025-03-25T22:10:11.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 661da6c1-fd23-421a-b171-2cacf51a48eb resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
112132025-03-25T22:10:11.722ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1755 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 661da6c1-fd23-421a-b171-2cacf51a48eb response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
112142025-03-25T22:10:12.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 36bbbf36-ef9e-4893-a64f-e1d4f1002a30 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
112152025-03-25T22:10:12.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 36bbbf36-ef9e-4893-a64f-e1d4f1002a30 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
112162025-03-25T22:10:12.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2293 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 36bbbf36-ef9e-4893-a64f-e1d4f1002a30 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
112172025-03-25T22:10:13.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39424 req_id = eb724d35-7be5-4881-ba00-7f34c20f8d81 roles = RoleSet { roles: {} } uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
112182025-03-25T22:10:13.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39424 req_id = eb724d35-7be5-4881-ba00-7f34c20f8d81 resource = Database result = Ok(()) uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
112192025-03-25T22:10:13.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2702 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39424 req_id = eb724d35-7be5-4881-ba00-7f34c20f8d81 response_code = 200 uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
112202025-03-25T22:10:13.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39424 req_id = b160db6f-de96-4237-addd-bf348946c631 roles = RoleSet { roles: {} } uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
112212025-03-25T22:10:13.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39424 req_id = b160db6f-de96-4237-addd-bf348946c631 resource = Database result = Ok(()) uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
112222025-03-25T22:10:13.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2725 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39424 req_id = b160db6f-de96-4237-addd-bf348946c631 response_code = 200 uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
112232025-03-25T22:10:13.765ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d3f90093-6cb4-4b7b-acec-6deb07492a95 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
112242025-03-25T22:10:13.765ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d3f90093-6cb4-4b7b-acec-6deb07492a95 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
112252025-03-25T22:10:13.767ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2246 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d3f90093-6cb4-4b7b-acec-6deb07492a95 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
112262025-03-25T22:10:14.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 70e354bd-9b6b-43a1-9559-e519041b9b8d roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
112272025-03-25T22:10:14.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 70e354bd-9b6b-43a1-9559-e519041b9b8d resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
112282025-03-25T22:10:14.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2045 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 70e354bd-9b6b-43a1-9559-e519041b9b8d response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
112292025-03-25T22:10:15.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 51c185db-5d44-47c8-89ce-b4eedcd8eabe roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
112302025-03-25T22:10:15.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 51c185db-5d44-47c8-89ce-b4eedcd8eabe resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
112312025-03-25T22:10:15.812ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2134 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 51c185db-5d44-47c8-89ce-b4eedcd8eabe response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
112322025-03-25T22:10:16.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f69564f8-3450-4e8d-a2fd-16b8dcb8cd3e roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
112332025-03-25T22:10:16.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f69564f8-3450-4e8d-a2fd-16b8dcb8cd3e resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
112342025-03-25T22:10:16.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2030 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f69564f8-3450-4e8d-a2fd-16b8dcb8cd3e response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
112352025-03-25T22:10:17.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 64c60308-91b3-4b72-897f-0eb0156d7167 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
112362025-03-25T22:10:17.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 64c60308-91b3-4b72-897f-0eb0156d7167 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
112372025-03-25T22:10:17.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1965 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 64c60308-91b3-4b72-897f-0eb0156d7167 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
112382025-03-25T22:10:18.573ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 496 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = 40efb122-31b7-4a3e-9723-e92199e192b1 response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
112392025-03-25T22:10:18.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6cf0ca6f-c9c6-4288-bffe-6f2a68aac795 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
112402025-03-25T22:10:18.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6cf0ca6f-c9c6-4288-bffe-6f2a68aac795 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
112412025-03-25T22:10:18.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2115 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6cf0ca6f-c9c6-4288-bffe-6f2a68aac795 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
112422025-03-25T22:10:19.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 9e6a3e7f-33ef-4b60-9840-18256e4ddb7a roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
112432025-03-25T22:10:19.898ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 9e6a3e7f-33ef-4b60-9840-18256e4ddb7a resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
112442025-03-25T22:10:19.900ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2097 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 9e6a3e7f-33ef-4b60-9840-18256e4ddb7a response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
112452025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
112462025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
112472025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
112482025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
112492025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
112502025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
112512025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
112522025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
112532025-03-25T22:10:20.844ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:82 reason = blueprint disabled target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7
112542025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
112552025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.72\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7"}
112562025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
112572025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
112582025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
112592025-03-25T22:10:20.844ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-03-25 22:00:20.844326195 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
112602025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
112612025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
112622025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
112632025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 21 reason = Timeout
112642025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
112652025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
112662025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
112672025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
112682025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
112692025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
112702025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
112712025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
112722025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
112732025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
112742025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112752025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
112762025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
112772025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
112782025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112792025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
112802025-03-25T22:10:20.844ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
112812025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
112822025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112832025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
112842025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
112852025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
112862025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
112872025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
112882025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
112892025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
112902025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
112912025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
112922025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
112932025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
112942025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): activating background_task = tuf_artifact_replication iteration = 3 reason = Timeout
112952025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 21 reason = Timeout
112962025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
112972025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
112982025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
112992025-03-25T22:10:20.844ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
113002025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113012025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
113022025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
113032025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
113042025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
113052025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
113062025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
113072025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
113082025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
113092025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
113102025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
113112025-03-25T22:10:20.844ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
113122025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
113132025-03-25T22:10:20.844ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
113142025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
113152025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 5 reason = Timeout
113162025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
113172025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
113182025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
113192025-03-25T22:10:20.844ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
113202025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
113212025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
113222025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
113232025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
113242025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
113252025-03-25T22:10:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
113262025-03-25T22:10:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
113272025-03-25T22:10:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
113282025-03-25T22:10:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
113292025-03-25T22:10:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
113302025-03-25T22:10:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
113312025-03-25T22:10:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
113322025-03-25T22:10:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
113332025-03-25T22:10:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113342025-03-25T22:10:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
113352025-03-25T22:10:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
113362025-03-25T22:10:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113372025-03-25T22:10:20.845ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
113382025-03-25T22:10:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
113392025-03-25T22:10:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
113402025-03-25T22:10:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113412025-03-25T22:10:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
113422025-03-25T22:10:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
113432025-03-25T22:10:20.845ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("58d382a7-99da-40a7-bc9f-2da7e9b156c1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d42076c6-06fe-4102-a978-c7d0a8dffb98.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d42076c6-06fe-4102-a978-c7d0a8dffb98.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 6774, tv_nsec: 180975230 } })
113442025-03-25T22:10:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
113452025-03-25T22:10:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113462025-03-25T22:10:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
113472025-03-25T22:10:20.845ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5533f428-2028-4269-b7b1-f15912c01133.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("66b022b6-2e12-413e-b4b7-56c4ad5bdd77.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f337d25b-c67a-4a32-89e1-e187aea97ed9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f337d25b-c67a-4a32-89e1-e187aea97ed9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 6774, tv_nsec: 181046841 } })
113482025-03-25T22:10:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
113492025-03-25T22:10:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
113502025-03-25T22:10:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
113512025-03-25T22:10:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
113522025-03-25T22:10:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
113532025-03-25T22:10:20.845ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
113542025-03-25T22:10:20.845ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.318743ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
113552025-03-25T22:10:20.845ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
113562025-03-25T22:10:20.845ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.234121ms iteration = 11 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
113572025-03-25T22:10:20.846ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113582025-03-25T22:10:20.846ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
113592025-03-25T22:10:20.847ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6774, tv_nsec: 182768571 } })
113602025-03-25T22:10:20.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
113612025-03-25T22:10:20.847ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1171
113622025-03-25T22:10:20.847ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6774, tv_nsec: 183541265 } })
113632025-03-25T22:10:20.848ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1171
113642025-03-25T22:10:20.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
113652025-03-25T22:10:20.848ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
113662025-03-25T22:10:20.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
113672025-03-25T22:10:20.848ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.247964ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
113682025-03-25T22:10:20.850ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
113692025-03-25T22:10:20.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
113702025-03-25T22:10:20.850ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-03-25 22:00:20.844326195 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
113712025-03-25T22:10:20.850ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 6.232169ms iteration = 11 status = {"expiration":"2025-03-25T22:00:20.844326195Z","pruned":[]}
113722025-03-25T22:10:20.851ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113732025-03-25T22:10:20.851ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113742025-03-25T22:10:20.851ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113752025-03-25T22:10:20.855ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
113762025-03-25T22:10:20.855ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
113772025-03-25T22:10:20.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
113782025-03-25T22:10:20.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
113792025-03-25T22:10:20.855ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
113802025-03-25T22:10:20.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
113812025-03-25T22:10:20.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
113822025-03-25T22:10:20.857ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
113832025-03-25T22:10:20.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
113842025-03-25T22:10:20.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113852025-03-25T22:10:20.859ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113862025-03-25T22:10:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
113872025-03-25T22:10:20.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113882025-03-25T22:10:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113892025-03-25T22:10:20.862ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
113902025-03-25T22:10:20.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
113912025-03-25T22:10:20.863ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
113922025-03-25T22:10:20.863ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113932025-03-25T22:10:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113942025-03-25T22:10:20.863ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113952025-03-25T22:10:20.864ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 20.106921ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
113962025-03-25T22:10:20.864ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113972025-03-25T22:10:20.865ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113982025-03-25T22:10:20.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
113992025-03-25T22:10:20.867ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
114002025-03-25T22:10:20.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
114012025-03-25T22:10:20.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
114022025-03-25T22:10:20.868ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
114032025-03-25T22:10:20.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
114042025-03-25T22:10:20.869ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
114052025-03-25T22:10:20.869ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
114062025-03-25T22:10:20.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
114072025-03-25T22:10:20.870ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114082025-03-25T22:10:20.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114092025-03-25T22:10:20.872ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114102025-03-25T22:10:20.873ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114112025-03-25T22:10:20.876ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
114122025-03-25T22:10:20.877ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
114132025-03-25T22:10:20.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
114142025-03-25T22:10:20.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
114152025-03-25T22:10:20.878ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
114162025-03-25T22:10:20.878ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 34.053935ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
114172025-03-25T22:10:20.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
114182025-03-25T22:10:20.890ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
114192025-03-25T22:10:20.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
114202025-03-25T22:10:20.891ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114212025-03-25T22:10:20.892ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
114222025-03-25T22:10:20.892ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114232025-03-25T22:10:20.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
114242025-03-25T22:10:20.893ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
114252025-03-25T22:10:20.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
114262025-03-25T22:10:20.898ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
114272025-03-25T22:10:20.899ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
114282025-03-25T22:10:20.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114292025-03-25T22:10:20.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114302025-03-25T22:10:20.900ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
114312025-03-25T22:10:20.900ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
114322025-03-25T22:10:20.900ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
114332025-03-25T22:10:20.900ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
114342025-03-25T22:10:20.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
114352025-03-25T22:10:20.903ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114362025-03-25T22:10:20.905ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114372025-03-25T22:10:20.905ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6774, tv_nsec: 241372565 } })
114382025-03-25T22:10:20.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114392025-03-25T22:10:20.906ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1171 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
114402025-03-25T22:10:20.907ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 62.95287ms iteration = 21 status = {"errors":[],"finish_invoked_ok":[]}
114412025-03-25T22:10:20.908ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
114422025-03-25T22:10:20.908ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114432025-03-25T22:10:20.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114442025-03-25T22:10:20.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
114452025-03-25T22:10:20.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
114462025-03-25T22:10:20.912ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114472025-03-25T22:10:20.913ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
114482025-03-25T22:10:20.913ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 69.24489ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
114492025-03-25T22:10:20.915ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
114502025-03-25T22:10:20.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
114512025-03-25T22:10:20.916ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114522025-03-25T22:10:20.918ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
114532025-03-25T22:10:20.918ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
114542025-03-25T22:10:20.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
114552025-03-25T22:10:20.919ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
114562025-03-25T22:10:20.919ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
114572025-03-25T22:10:20.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c26ec76a-f507-48b1-b18b-382c8ab5da2c roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
114582025-03-25T22:10:20.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
114592025-03-25T22:10:20.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c26ec76a-f507-48b1-b18b-382c8ab5da2c resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
114602025-03-25T22:10:20.930ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
114612025-03-25T22:10:20.930ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114622025-03-25T22:10:20.930ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
114632025-03-25T22:10:20.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
114642025-03-25T22:10:20.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
114652025-03-25T22:10:20.934ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
114662025-03-25T22:10:20.934ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
114672025-03-25T22:10:20.934ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 89.451813ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
114682025-03-25T22:10:20.934ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
114692025-03-25T22:10:20.934ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114702025-03-25T22:10:20.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114712025-03-25T22:10:20.935ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
114722025-03-25T22:10:20.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
114732025-03-25T22:10:20.938ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 93.547554ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
114742025-03-25T22:10:20.938ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114752025-03-25T22:10:20.938ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 94.328837ms iteration = 21 status = {"errors":[],"requests_created_ok":[]}
114762025-03-25T22:10:20.939ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114772025-03-25T22:10:20.939ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 95.474048ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
114782025-03-25T22:10:20.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114792025-03-25T22:10:20.943ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
114802025-03-25T22:10:20.943ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
114812025-03-25T22:10:20.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
114822025-03-25T22:10:20.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 26625 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c26ec76a-f507-48b1-b18b-382c8ab5da2c response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
114832025-03-25T22:10:20.947ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
114842025-03-25T22:10:20.947ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
114852025-03-25T22:10:20.947ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
114862025-03-25T22:10:20.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
114872025-03-25T22:10:20.956ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
114882025-03-25T22:10:20.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
114892025-03-25T22:10:20.965ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
114902025-03-25T22:10:20.965ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
114912025-03-25T22:10:20.965ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
114922025-03-25T22:10:20.965ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
114932025-03-25T22:10:20.965ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 121.403ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
114942025-03-25T22:10:20.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
114952025-03-25T22:10:20.979ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114962025-03-25T22:10:20.982ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
114972025-03-25T22:10:20.982ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
114982025-03-25T22:10:20.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
114992025-03-25T22:10:20.984ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
115002025-03-25T22:10:20.985ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 140.300811ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
115012025-03-25T22:10:20.986ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
115022025-03-25T22:10:20.987ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
115032025-03-25T22:10:20.987ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 142.58218ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
115042025-03-25T22:10:20.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
115052025-03-25T22:10:20.987ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
115062025-03-25T22:10:20.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
115072025-03-25T22:10:20.994ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
115082025-03-25T22:10:20.994ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
115092025-03-25T22:10:20.994ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 150.142693ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
115102025-03-25T22:10:20.997ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
115112025-03-25T22:10:20.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
115122025-03-25T22:10:21.007ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
115132025-03-25T22:10:21.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
115142025-03-25T22:10:21.066ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
115152025-03-25T22:10:21.068ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
115162025-03-25T22:10:21.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
115172025-03-25T22:10:21.082ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 238.413605ms iteration = 23 status = {"physical_disks_added":0}
115182025-03-25T22:10:21.115ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 zone_address = fd00:1122:3344:101::2
115192025-03-25T22:10:21.115ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
115202025-03-25T22:10:21.116ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "18884374-227c-4e23-ac78-e740e3b25326", "content-length": "26", "date": "Tue, 25 Mar 2025 22:10:21 GMT"} })
115212025-03-25T22:10:21.116ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1184 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
115222025-03-25T22:10:21.118ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
115232025-03-25T22:10:21.126ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
115242025-03-25T22:10:21.126ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
115252025-03-25T22:10:21.127ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e08b315-95f2-4c2f-ac90-45c993edf48e", "content-length": "372", "date": "Tue, 25 Mar 2025 22:10:21 GMT"} })
115262025-03-25T22:10:21.127ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115272025-03-25T22:10:21.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115282025-03-25T22:10:21.129ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 284.54819ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
115292025-03-25T22:10:21.129ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115302025-03-25T22:10:21.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115312025-03-25T22:10:21.132ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115322025-03-25T22:10:21.133ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115332025-03-25T22:10:21.139ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
115342025-03-25T22:10:21.139ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
115352025-03-25T22:10:21.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
115362025-03-25T22:10:21.140ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
115372025-03-25T22:10:21.140ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
115382025-03-25T22:10:21.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
115392025-03-25T22:10:21.143ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115402025-03-25T22:10:21.145ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
115412025-03-25T22:10:21.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
115422025-03-25T22:10:21.146ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
115432025-03-25T22:10:21.146ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
115442025-03-25T22:10:21.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
115452025-03-25T22:10:21.149ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115462025-03-25T22:10:21.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115472025-03-25T22:10:21.153ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115482025-03-25T22:10:21.156ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
115492025-03-25T22:10:21.156ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
115502025-03-25T22:10:21.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
115512025-03-25T22:10:21.159ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115522025-03-25T22:10:21.163ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
115532025-03-25T22:10:21.163ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
115542025-03-25T22:10:21.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
115552025-03-25T22:10:21.167ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
115562025-03-25T22:10:21.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
115572025-03-25T22:10:21.169ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115582025-03-25T22:10:21.172ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
115592025-03-25T22:10:21.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
115602025-03-25T22:10:21.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
115612025-03-25T22:10:21.174ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115622025-03-25T22:10:21.177ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
115632025-03-25T22:10:21.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
115642025-03-25T22:10:21.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
115652025-03-25T22:10:21.183ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:113 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
115662025-03-25T22:10:21.183ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 339.024932ms iteration = 5 status = {"blueprint_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","inventory_collection_id":"fc6c9148-0a29-46f4-a0bf-8838f37c405a","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
115672025-03-25T22:10:21.215ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
115682025-03-25T22:10:21.215ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 23d93905-7b89-4296-b050-7ff9ae235c15 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
115692025-03-25T22:10:21.215ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
115702025-03-25T22:10:21.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
115712025-03-25T22:10:21.217ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115722025-03-25T22:10:21.220ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
115732025-03-25T22:10:21.220ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
115742025-03-25T22:10:21.220ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
115752025-03-25T22:10:21.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
115762025-03-25T22:10:21.222ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
115772025-03-25T22:10:21.222ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 96679ce4-e18c-487b-803a-7b26be55e85c dns_zone_name = oxide.test found_so_far = 0 version = 2
115782025-03-25T22:10:21.222ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
115792025-03-25T22:10:21.222ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
115802025-03-25T22:10:21.222ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
115812025-03-25T22:10:21.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
115822025-03-25T22:10:21.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
115832025-03-25T22:10:21.229ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-03-25T22:00:16.382271Z, time_modified: 2025-03-25T22:00:16.382271Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, db_silo: Silo { identity: SiloIdentity { id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-25T22:00:22.501108Z, time_modified: 2025-03-25T22:00:22.501108Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, db_silo: Silo { identity: SiloIdentity { id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-25T22:00:22.501108Z, time_modified: 2025-03-25T22:00:22.501108Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d" }] }) }
115842025-03-25T22:10:21.229ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 384.955164ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"5c35ff8c-21dd-48b9-9751-76bfa681bc38","tls_certs":["0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d"]}},"default_endpoint":{"silo_id":"5c35ff8c-21dd-48b9-9751-76bfa681bc38","tls_certs":["0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
115852025-03-25T22:10:21.229ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115862025-03-25T22:10:21.229ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
115872025-03-25T22:10:21.229ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115882025-03-25T22:10:21.229ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
115892025-03-25T22:10:21.230ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "08dd79ba-fc51-49a6-853b-ca48f9615c93", "content-length": "26", "date": "Tue, 25 Mar 2025 22:10:21 GMT"} })
115902025-03-25T22:10:21.230ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
115912025-03-25T22:10:21.231ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:360
115922025-03-25T22:10:21.231ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 386.889398ms iteration = 21 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
115932025-03-25T22:10:21.233ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
115942025-03-25T22:10:21.234ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
115952025-03-25T22:10:21.234ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 23d93905-7b89-4296-b050-7ff9ae235c15 dns_zone_name = control-plane.oxide.internal found_so_far = 52 version = 1
115962025-03-25T22:10:21.234ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
115972025-03-25T22:10:21.234ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-03-25 22:00:21.368103 UTC dns_group = internal generation = 1
115982025-03-25T22:10:21.234ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 390.361769ms iteration = 11 status = {"generation":1}
115992025-03-25T22:10:21.235ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f034aaf6-2037-4cb4-8409-3ab31c15cc28, lookup_type: ById(f034aaf6-2037-4cb4-8409-3ab31c15cc28) } result = Ok(())
116002025-03-25T22:10:21.235ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
116012025-03-25T22:10:21.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
116022025-03-25T22:10:21.236ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
116032025-03-25T22:10:21.236ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
116042025-03-25T22:10:21.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
116052025-03-25T22:10:21.239ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 395.280315ms iteration = 21 status = 0
116062025-03-25T22:10:21.252ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
116072025-03-25T22:10:21.252ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
116082025-03-25T22:10:21.252ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e69c535e-3152-49de-8c19-1ff717f3e741", "date": "Tue, 25 Mar 2025 22:10:21 GMT"} })
116092025-03-25T22:10:21.252ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
116102025-03-25T22:10:21.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
116112025-03-25T22:10:21.253ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
116122025-03-25T22:10:21.257ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
116132025-03-25T22:10:21.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
116142025-03-25T22:10:21.262ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
116152025-03-25T22:10:21.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
116162025-03-25T22:10:21.263ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
116172025-03-25T22:10:21.263ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
116182025-03-25T22:10:21.264ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e599dfa3-edf6-490e-8a7a-36dc3eed03a0", "content-length": "26", "date": "Tue, 25 Mar 2025 22:10:21 GMT"} })
116192025-03-25T22:10:21.264ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
116202025-03-25T22:10:21.266ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
116212025-03-25T22:10:21.273ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
116222025-03-25T22:10:21.273ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
116232025-03-25T22:10:21.274ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1de220ef-e465-4a20-9c71-64dd33e15913", "date": "Tue, 25 Mar 2025 22:10:21 GMT"} })
116242025-03-25T22:10:21.276ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 431.524407ms iteration = 21 status = {}
116252025-03-25T22:10:21.276ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
116262025-03-25T22:10:21.276ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 432.318432ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
116272025-03-25T22:10:21.279ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116282025-03-25T22:10:21.280ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
116292025-03-25T22:10:21.280ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
116302025-03-25T22:10:21.280ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 435.458947ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
116312025-03-25T22:10:21.284ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
116322025-03-25T22:10:21.284ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
116332025-03-25T22:10:21.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
116342025-03-25T22:10:21.287ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 96679ce4-e18c-487b-803a-7b26be55e85c dns_zone_name = oxide.test found_so_far = 1 version = 2
116352025-03-25T22:10:21.287ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
116362025-03-25T22:10:21.287ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-03-25 22:00:22.561696 UTC dns_group = external generation = 2
116372025-03-25T22:10:21.287ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 442.877466ms iteration = 11 status = {"generation":2}
116382025-03-25T22:10:21.295ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
116392025-03-25T22:10:21.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
116402025-03-25T22:10:21.298ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
116412025-03-25T22:10:21.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
116422025-03-25T22:10:21.300ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116432025-03-25T22:10:21.309ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
116442025-03-25T22:10:21.309ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
116452025-03-25T22:10:21.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
116462025-03-25T22:10:21.314ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
116472025-03-25T22:10:21.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
116482025-03-25T22:10:21.315ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
116492025-03-25T22:10:21.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
116502025-03-25T22:10:21.318ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
116512025-03-25T22:10:21.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
116522025-03-25T22:10:21.343ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
116532025-03-25T22:10:21.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
116542025-03-25T22:10:21.388ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 544.41483ms iteration = 21 status = {}
116552025-03-25T22:10:21.404ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
116562025-03-25T22:10:21.404ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "9c42318a-af6d-410a-9fe9-524cbd69612e", "date": "Tue, 25 Mar 2025 22:10:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
116572025-03-25T22:10:21.404ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
116582025-03-25T22:10:21.406ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "88492232-58ae-462e-9d10-c687039bc533", "date": "Tue, 25 Mar 2025 22:10:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
116592025-03-25T22:10:21.406ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
116602025-03-25T22:10:21.408ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
116612025-03-25T22:10:21.408ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 563.849669ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
116622025-03-25T22:10:21.417ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
116632025-03-25T22:10:21.418ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "afa7c737-6f0d-4fd0-a1f2-2f957605f080", "date": "Tue, 25 Mar 2025 22:10:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
116642025-03-25T22:10:21.418ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
116652025-03-25T22:10:21.419ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "7aeb4a48-985c-431e-af38-d2318e064a4e", "date": "Tue, 25 Mar 2025 22:10:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
116662025-03-25T22:10:21.419ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
116672025-03-25T22:10:21.421ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "2c7de20d-e259-46ee-a462-1b9b793e438b", "date": "Tue, 25 Mar 2025 22:10:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
116682025-03-25T22:10:21.421ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
116692025-03-25T22:10:21.423ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
116702025-03-25T22:10:21.423ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
116712025-03-25T22:10:21.423ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 579.021685ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
116722025-03-25T22:10:21.424ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b73ab63f-a3be-447c-8633-3d2d69c19ed7", "content-length": "1", "date": "Tue, 25 Mar 2025 22:10:21 GMT"} })
116732025-03-25T22:10:21.425ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
116742025-03-25T22:10:21.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
116752025-03-25T22:10:21.425ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
116762025-03-25T22:10:21.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
116772025-03-25T22:10:21.428ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
116782025-03-25T22:10:21.428ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116792025-03-25T22:10:21.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
116802025-03-25T22:10:21.429ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116812025-03-25T22:10:21.429ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 585.343705ms iteration = 21 status = null
116822025-03-25T22:10:21.431ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
116832025-03-25T22:10:21.431ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
116842025-03-25T22:10:21.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
116852025-03-25T22:10:21.432ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
116862025-03-25T22:10:21.432ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
116872025-03-25T22:10:21.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
116882025-03-25T22:10:21.433ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116892025-03-25T22:10:21.434ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
116902025-03-25T22:10:21.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
116912025-03-25T22:10:21.435ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
116922025-03-25T22:10:21.435ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
116932025-03-25T22:10:21.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
116942025-03-25T22:10:21.464ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116952025-03-25T22:10:21.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116962025-03-25T22:10:21.466ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
116972025-03-25T22:10:21.467ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a5db250-fa3f-4168-ab16-5c36568c22e2, rack_id: c7210e4b-5a81-4ec8-b8fe-816a9508dc74, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(6d5dda50-e3c4-4853-9bfa-a66b447ab351) } rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
116982025-03-25T22:10:21.467ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116992025-03-25T22:10:21.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117002025-03-25T22:10:21.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
117012025-03-25T22:10:21.472ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117022025-03-25T22:10:21.474ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
117032025-03-25T22:10:21.474ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
117042025-03-25T22:10:21.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
117052025-03-25T22:10:21.479ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = tuf_artifact_replication body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/artifacts-config
117062025-03-25T22:10:21.483ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
117072025-03-25T22:10:21.499ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "1cd37545-4e12-4319-9c7e-e878faeddb5e", "content-length": "134", "date": "Tue, 25 Mar 2025 22:10:21 GMT"} })
117082025-03-25T22:10:21.499ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
117092025-03-25T22:10:21.499ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 6d5dda50-e3c4-4853-9bfa-a66b447ab351
117102025-03-25T22:10:21.499ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
117112025-03-25T22:10:21.499ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
117122025-03-25T22:10:21.500ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
117132025-03-25T22:10:21.500ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
117142025-03-25T22:10:21.500ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
117152025-03-25T22:10:21.500ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
117162025-03-25T22:10:21.500ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
117172025-03-25T22:10:21.500ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
117182025-03-25T22:10:21.500ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
117192025-03-25T22:10:21.500ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
117202025-03-25T22:10:21.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
117212025-03-25T22:10:21.503ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
117222025-03-25T22:10:21.503ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5bb4135-570a-49d9-8917-5aa4b818adaa", "content-length": "2", "date": "Tue, 25 Mar 2025 22:10:21 GMT"} })
117232025-03-25T22:10:21.503ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
117242025-03-25T22:10:21.503ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "68bd1bef-082f-4738-86e2-c5373e72d7f6", "content-length": "52", "date": "Tue, 25 Mar 2025 22:10:21 GMT"} })
117252025-03-25T22:10:21.503ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
117262025-03-25T22:10:21.503ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
117272025-03-25T22:10:21.522ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117282025-03-25T22:10:21.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117292025-03-25T22:10:21.524ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117302025-03-25T22:10:21.530ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
117312025-03-25T22:10:21.530ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117322025-03-25T22:10:21.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117332025-03-25T22:10:21.557ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
117342025-03-25T22:10:21.560ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117352025-03-25T22:10:21.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117362025-03-25T22:10:21.562ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117372025-03-25T22:10:21.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117382025-03-25T22:10:21.566ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117392025-03-25T22:10:21.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117402025-03-25T22:10:21.568ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117412025-03-25T22:10:21.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117422025-03-25T22:10:21.600ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "9c0fc938-6b01-4380-b493-18c449dce672", "content-length": "691", "date": "Tue, 25 Mar 2025 22:10:21 GMT"} })
117432025-03-25T22:10:21.600ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
117442025-03-25T22:10:21.600ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
117452025-03-25T22:10:21.600ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
117462025-03-25T22:10:21.602ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 757.877578ms iteration = 21 status = {}
117472025-03-25T22:10:21.604ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117482025-03-25T22:10:21.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117492025-03-25T22:10:21.607ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts-config", status: 204, headers: {"x-request-id": "e149d5f9-6873-4c44-a41d-1ec3fec7acdc", "date": "Tue, 25 Mar 2025 22:10:21 GMT"} })
117502025-03-25T22:10:21.607ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = tuf_artifact_replication body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/artifacts
117512025-03-25T22:10:21.607ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts", status: 200, headers: {"content-type": "application/json", "x-request-id": "9027a268-0678-4a44-af62-54cee3a998f3", "content-length": "26", "date": "Tue, 25 Mar 2025 22:10:21 GMT"} })
117522025-03-25T22:10:21.607ZINFOnexus (BackgroundTasks): Successfully got artifact list background_task = tuf_artifact_replication file = nexus/src/app/background/tasks/tuf_artifact_replication.rs:673 sled = http://[fd00:1122:3344:101::1]:12345
117532025-03-25T22:10:21.610ZDEBGnexus (BackgroundTasks): activation complete background_task = tuf_artifact_replication elapsed = 765.4246ms iteration = 3 status = {"generation":1,"last_run_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":1,"put_config_err":0,"put_config_ok":1,"put_err":0,"put_ok":0},"lifetime_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":3,"put_config_err":0,"put_config_ok":3,"put_err":0,"put_ok":0},"local_repos":0,"request_debug_ringbuf":[{"generation":1,"operation":"put_config","target_sled":"f034aaf6-2037-4cb4-8409-3ab31c15cc28","time":"2025-03-25T22:00:21.321183573Z"},{"operation":"list","target_sled":"f034aaf6-2037-4cb4-8409-3ab31c15cc28","time":"2025-03-25T22:00:21.323912581Z"},{"generation":1,"operation":"put_config","target_sled":"f034aaf6-2037-4cb4-8409-3ab31c15cc28","time":"2025-03-25T22:05:21.426700637Z"},{"operation":"list","target_sled":"f034aaf6-2037-4cb4-8409-3ab31c15cc28","time":"2025-03-25T22:05:21.427093324Z"},{"generation":1,"operation":"put_config","target_sled":"f034aaf6-2037-4cb4-8409-3ab31c15cc28","time":"2025-03-25T22:10:21.607012098Z"},{"operation":"list","target_sled":"f034aaf6-2037-4cb4-8409-3ab31c15cc28","time":"2025-03-25T22:10:21.607531317Z"}]}
117542025-03-25T22:10:21.650ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117552025-03-25T22:10:21.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117562025-03-25T22:10:21.652ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117572025-03-25T22:10:21.657ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
117582025-03-25T22:10:21.657ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117592025-03-25T22:10:21.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117602025-03-25T22:10:21.659ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117612025-03-25T22:10:21.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117622025-03-25T22:10:21.698ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117632025-03-25T22:10:21.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117642025-03-25T22:10:21.700ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117652025-03-25T22:10:21.704ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
117662025-03-25T22:10:21.704ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117672025-03-25T22:10:21.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117682025-03-25T22:10:21.709ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117692025-03-25T22:10:21.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117702025-03-25T22:10:21.719ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117712025-03-25T22:10:21.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117722025-03-25T22:10:21.722ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117732025-03-25T22:10:21.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117742025-03-25T22:10:21.727ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117752025-03-25T22:10:21.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117762025-03-25T22:10:21.730ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117772025-03-25T22:10:21.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117782025-03-25T22:10:21.735ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117792025-03-25T22:10:21.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117802025-03-25T22:10:21.737ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117812025-03-25T22:10:21.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117822025-03-25T22:10:21.738ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117832025-03-25T22:10:21.741ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "87032ad3-ff43-40fb-8faf-b266e6f0a9e1", "date": "Tue, 25 Mar 2025 22:10:21 GMT"} })
117842025-03-25T22:10:21.741ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch = Switch0
117852025-03-25T22:10:21.741ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
117862025-03-25T22:10:21.741ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8b48ccd1-0f7d-416a-9413-b0e23a2dde33", "content-length": "682", "date": "Tue, 25 Mar 2025 22:10:21 GMT"} })
117872025-03-25T22:10:21.741ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
117882025-03-25T22:10:21.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
117892025-03-25T22:10:21.742ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
117902025-03-25T22:10:21.742ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117912025-03-25T22:10:21.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117922025-03-25T22:10:21.744ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117932025-03-25T22:10:21.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117942025-03-25T22:10:21.746ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
117952025-03-25T22:10:21.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
117962025-03-25T22:10:21.746ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117972025-03-25T22:10:21.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117982025-03-25T22:10:21.748ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117992025-03-25T22:10:21.749ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
118002025-03-25T22:10:21.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
118012025-03-25T22:10:21.755ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
118022025-03-25T22:10:21.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
118032025-03-25T22:10:21.755ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
118042025-03-25T22:10:21.755ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
118052025-03-25T22:10:21.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
118062025-03-25T22:10:21.763ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 12a41e9e-9631-4d38-b839-8dd2f1307510, kind: Service { id: f578ebd7-76c9-43f2-8d8c-99a164224c1c }, name: Name("nexus-f578ebd7-76c9-43f2-8d8c-99a164224c1c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 27c97441-bb9e-4408-b832-44b304dbd319, kind: Service { id: dc04dd71-e9ce-4d94-8637-d87f47eb7409 }, name: Name("nexus-dc04dd71-e9ce-4d94-8637-d87f47eb7409"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 244])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: de8b1653-42da-41b0-b524-fe87fd1390a1, kind: Service { id: 76a4636e-6952-47a1-8a71-cd6816e00858 }, name: Name("nexus-76a4636e-6952-47a1-8a71-cd6816e00858"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 87])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 29ce53a2-9f51-4baa-936c-a430afb38f28, kind: Service { id: d42076c6-06fe-4102-a978-c7d0a8dffb98 }, name: Name("external-dns-d42076c6-06fe-4102-a978-c7d0a8dffb98"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 55e2e815-bc90-43ee-bb61-e37b76792d5f, kind: Service { id: 58d382a7-99da-40a7-bc9f-2da7e9b156c1 }, name: Name("external-dns-58d382a7-99da-40a7-bc9f-2da7e9b156c1"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 30])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
118072025-03-25T22:10:21.763ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
118082025-03-25T22:10:21.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
118092025-03-25T22:10:21.764ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 919.630484ms iteration = 21 status = {}
118102025-03-25T22:10:21.765ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118112025-03-25T22:10:21.767ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
118122025-03-25T22:10:21.767ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
118132025-03-25T22:10:21.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
118142025-03-25T22:10:21.769ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
118152025-03-25T22:10:21.769ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 29ce53a2-9f51-4baa-936c-a430afb38f28, kind: Service { id: d42076c6-06fe-4102-a978-c7d0a8dffb98 }, name: Name("external-dns-d42076c6-06fe-4102-a978-c7d0a8dffb98"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 55e2e815-bc90-43ee-bb61-e37b76792d5f, kind: Service { id: 58d382a7-99da-40a7-bc9f-2da7e9b156c1 }, name: Name("external-dns-58d382a7-99da-40a7-bc9f-2da7e9b156c1"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 30])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 12a41e9e-9631-4d38-b839-8dd2f1307510, kind: Service { id: f578ebd7-76c9-43f2-8d8c-99a164224c1c }, name: Name("nexus-f578ebd7-76c9-43f2-8d8c-99a164224c1c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 27c97441-bb9e-4408-b832-44b304dbd319, kind: Service { id: dc04dd71-e9ce-4d94-8637-d87f47eb7409 }, name: Name("nexus-dc04dd71-e9ce-4d94-8637-d87f47eb7409"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 244])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: de8b1653-42da-41b0-b524-fe87fd1390a1, kind: Service { id: 76a4636e-6952-47a1-8a71-cd6816e00858 }, name: Name("nexus-76a4636e-6952-47a1-8a71-cd6816e00858"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 87])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
118162025-03-25T22:10:21.769ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
118172025-03-25T22:10:21.893ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: f034aaf6-2037-4cb4-8409-3ab31c15cc28, time_created: 2025-03-25T22:00:19.994158Z, time_modified: 2025-03-25T22:00:19.994158Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: c7210e4b-5a81-4ec8-b8fe-816a9508dc74, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)), repo_depot_port: SqlU16(12348) }]
118182025-03-25T22:10:21.893ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
118192025-03-25T22:10:21.893ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
118202025-03-25T22:10:21.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
118212025-03-25T22:10:21.896ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
118222025-03-25T22:10:21.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
118232025-03-25T22:10:21.924ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118242025-03-25T22:10:21.927ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: f034aaf6-2037-4cb4-8409-3ab31c15cc28, lookup_type: ById(f034aaf6-2037-4cb4-8409-3ab31c15cc28) } result = Ok(())
118252025-03-25T22:10:21.958ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
118262025-03-25T22:10:21.966ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "1995f474-99e4-4967-87a9-b70266061aa9", "date": "Tue, 25 Mar 2025 22:10:21 GMT"} })
118272025-03-25T22:10:21.969ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
118282025-03-25T22:10:21.969ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 1.124431521s
118292025-03-25T22:10:21.969ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 1.124443022s iteration = 3 status = {}
118302025-03-25T22:10:21.980ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6f342e7a-90c7-4efe-8f6f-23a256c7b81d roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
118312025-03-25T22:10:21.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6f342e7a-90c7-4efe-8f6f-23a256c7b81d resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
118322025-03-25T22:10:21.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2295 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6f342e7a-90c7-4efe-8f6f-23a256c7b81d response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
118332025-03-25T22:10:22.145ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Timeout
118342025-03-25T22:10:22.145ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
118352025-03-25T22:10:22.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
118362025-03-25T22:10:22.147ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118372025-03-25T22:10:22.149ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
118382025-03-25T22:10:22.149ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
118392025-03-25T22:10:22.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
118402025-03-25T22:10:22.332ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(e18cce85-44d4-4c9f-80ed-ea40f3a819ef, 0), (eac53508-078d-4e05-aa88-5a3fdbd48e57, 0), (fc6c9148-0a29-46f4-a0bf-8838f37c405a, 0), (66241eff-9f38-4893-b1d1-37d224051251, 0)] collection_id = e18cce85-44d4-4c9f-80ed-ea40f3a819ef
118412025-03-25T22:10:22.332ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
118422025-03-25T22:10:22.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
118432025-03-25T22:10:23.001ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = eb38c78f-4602-4a61-ab65-e25a95ec596a roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
118442025-03-25T22:10:23.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = eb38c78f-4602-4a61-ab65-e25a95ec596a resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
118452025-03-25T22:10:23.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2751 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = eb38c78f-4602-4a61-ab65-e25a95ec596a response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
118462025-03-25T22:10:23.091ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = e18cce85-44d4-4c9f-80ed-ea40f3a819ef file = nexus/db-queries/src/db/datastore/inventory.rs:1442 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 84 nerrors = 0 nnics = 6 nnvme_disk_firmware = 11 nphysical_disks = 11 nrot_pages = 8 nrots = 2 nsled_agent_zones = 1 nsled_agents = 1 nsps = 2 nzones = 28 nzpools = 9
118472025-03-25T22:10:23.091ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
118482025-03-25T22:10:23.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
118492025-03-25T22:10:23.154ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(eac53508-078d-4e05-aa88-5a3fdbd48e57, 0), (fc6c9148-0a29-46f4-a0bf-8838f37c405a, 0), (66241eff-9f38-4893-b1d1-37d224051251, 0), (a4de4b7c-5bc2-430e-bd66-564d092d86b7, 0)] collection_id = eac53508-078d-4e05-aa88-5a3fdbd48e57
118502025-03-25T22:10:23.154ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
118512025-03-25T22:10:23.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
118522025-03-25T22:10:23.503ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = eac53508-078d-4e05-aa88-5a3fdbd48e57 file = nexus/db-queries/src/db/datastore/inventory.rs:1442 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 84 nerrors = 0 nnics = 6 nnvme_disk_firmware = 11 nphysical_disks = 11 nrot_pages = 8 nrots = 2 nsled_agent_zones = 1 nsled_agents = 1 nsps = 2 nzones = 28 nzpools = 9
118532025-03-25T22:10:23.503ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
118542025-03-25T22:10:23.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
118552025-03-25T22:10:23.510ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(fc6c9148-0a29-46f4-a0bf-8838f37c405a, 0), (66241eff-9f38-4893-b1d1-37d224051251, 0), (a4de4b7c-5bc2-430e-bd66-564d092d86b7, 0)]
118562025-03-25T22:10:23.510ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6776, tv_nsec: 846685345 } })
118572025-03-25T22:10:23.542ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
118582025-03-25T22:10:23.542ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
118592025-03-25T22:10:23.542ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
118602025-03-25T22:10:23.542ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "9205cbd7-3ac7-47c7-8651-6d2a3373e48c", "content-length": "476", "date": "Tue, 25 Mar 2025 22:10:23 GMT"} })
118612025-03-25T22:10:23.542ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
118622025-03-25T22:10:23.542ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4077864b-8504-4602-939f-6ded70d4618f", "content-length": "734", "date": "Tue, 25 Mar 2025 22:10:23 GMT"} })
118632025-03-25T22:10:23.542ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
118642025-03-25T22:10:23.543ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a913d71-e61f-4e02-ab07-73ec22300c9a", "content-length": "111", "date": "Tue, 25 Mar 2025 22:10:23 GMT"} })
118652025-03-25T22:10:23.543ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
118662025-03-25T22:10:23.543ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "48c6f8bb-7382-4f03-840a-3e0fe2e3abe5", "content-length": "111", "date": "Tue, 25 Mar 2025 22:10:23 GMT"} })
118672025-03-25T22:10:23.543ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
118682025-03-25T22:10:23.543ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "90a722b6-d9f4-415c-a1fe-e1a53f00de6c", "content-length": "167", "date": "Tue, 25 Mar 2025 22:10:23 GMT"} })
118692025-03-25T22:10:23.543ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
118702025-03-25T22:10:23.544ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c2f6818-4fbb-4d41-af99-c4e5646a6b57", "content-length": "167", "date": "Tue, 25 Mar 2025 22:10:23 GMT"} })
118712025-03-25T22:10:23.544ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
118722025-03-25T22:10:23.544ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7557c483-d882-4f07-bc14-b8e679c31768", "content-length": "175", "date": "Tue, 25 Mar 2025 22:10:23 GMT"} })
118732025-03-25T22:10:23.544ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
118742025-03-25T22:10:23.544ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "95f2b06b-0808-46b2-9f54-2930ced9a6de", "content-length": "175", "date": "Tue, 25 Mar 2025 22:10:23 GMT"} })
118752025-03-25T22:10:23.544ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
118762025-03-25T22:10:23.544ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a9d741b6-bba1-4bd8-9b98-d9d41ebad324", "content-length": "702", "date": "Tue, 25 Mar 2025 22:10:23 GMT"} })
118772025-03-25T22:10:23.544ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
118782025-03-25T22:10:23.544ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2ed4b10e-7630-4856-a136-32c4acae95d2", "content-length": "727", "date": "Tue, 25 Mar 2025 22:10:23 GMT"} })
118792025-03-25T22:10:23.544ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
118802025-03-25T22:10:23.544ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b1ebdbf-4777-4450-8772-9d6d8e4e7a7b", "content-length": "729", "date": "Tue, 25 Mar 2025 22:10:23 GMT"} })
118812025-03-25T22:10:23.545ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
118822025-03-25T22:10:23.545ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9075d9f8-bea5-4ea7-a7eb-f4cd4f18114b", "content-length": "728", "date": "Tue, 25 Mar 2025 22:10:23 GMT"} })
118832025-03-25T22:10:23.545ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
118842025-03-25T22:10:23.545ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "aab9a3ae-c5f5-411e-bf9a-6b0bae136b92", "content-length": "722", "date": "Tue, 25 Mar 2025 22:10:23 GMT"} })
118852025-03-25T22:10:23.545ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
118862025-03-25T22:10:23.545ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "55fbd0f3-10f5-4d0d-9d0a-f93d65584128", "content-length": "109", "date": "Tue, 25 Mar 2025 22:10:23 GMT"} })
118872025-03-25T22:10:23.545ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
118882025-03-25T22:10:23.545ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "739dcdd6-0cb8-4d5b-ade6-7480fd8d91a0", "content-length": "109", "date": "Tue, 25 Mar 2025 22:10:23 GMT"} })
118892025-03-25T22:10:23.545ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
118902025-03-25T22:10:23.546ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ef47452c-9d37-4ad4-8af1-6cf062df777c", "content-length": "169", "date": "Tue, 25 Mar 2025 22:10:23 GMT"} })
118912025-03-25T22:10:23.546ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
118922025-03-25T22:10:23.546ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ddff1a2f-1257-4cae-a975-3db0fd6a77ca", "content-length": "169", "date": "Tue, 25 Mar 2025 22:10:23 GMT"} })
118932025-03-25T22:10:23.546ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
118942025-03-25T22:10:23.546ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "875c4baf-465f-4135-b28b-ea56ecc28179", "content-length": "178", "date": "Tue, 25 Mar 2025 22:10:23 GMT"} })
118952025-03-25T22:10:23.546ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
118962025-03-25T22:10:23.546ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "cad4c09a-576b-4fa6-9f93-50cee0d2b815", "content-length": "178", "date": "Tue, 25 Mar 2025 22:10:23 GMT"} })
118972025-03-25T22:10:23.546ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
118982025-03-25T22:10:23.547ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "160f611e-d3f4-490c-ac94-1aaad41629e7", "content-length": "702", "date": "Tue, 25 Mar 2025 22:10:23 GMT"} })
118992025-03-25T22:10:23.547ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
119002025-03-25T22:10:23.547ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d2c8817-fa25-4cf9-bc26-8b192581155b", "content-length": "727", "date": "Tue, 25 Mar 2025 22:10:23 GMT"} })
119012025-03-25T22:10:23.547ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
119022025-03-25T22:10:23.547ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1dcb6e9-8d0c-4dd2-9a5e-0225d7360e8e", "content-length": "729", "date": "Tue, 25 Mar 2025 22:10:23 GMT"} })
119032025-03-25T22:10:23.547ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
119042025-03-25T22:10:23.547ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a16448f-78d8-4c1e-93e0-a5b024cb5c65", "content-length": "728", "date": "Tue, 25 Mar 2025 22:10:23 GMT"} })
119052025-03-25T22:10:23.547ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
119062025-03-25T22:10:23.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
119072025-03-25T22:10:23.549ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119082025-03-25T22:10:23.551ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
119092025-03-25T22:10:23.551ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
119102025-03-25T22:10:23.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
119112025-03-25T22:10:23.553ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119122025-03-25T22:10:23.555ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
119132025-03-25T22:10:23.555ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
119142025-03-25T22:10:23.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
119152025-03-25T22:10:23.643ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
119162025-03-25T22:10:23.643ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
119172025-03-25T22:10:23.838ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "249117c0-6342-480f-b3a1-35d25baded10", "content-length": "31971", "date": "Tue, 25 Mar 2025 22:10:23 GMT"} })
119182025-03-25T22:10:23.840ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
119192025-03-25T22:10:23.840ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
119202025-03-25T22:10:23.840ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
119212025-03-25T22:10:23.842ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
119222025-03-25T22:10:23.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
119232025-03-25T22:10:23.844ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119242025-03-25T22:10:23.845ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
119252025-03-25T22:10:23.845ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
119262025-03-25T22:10:23.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
119272025-03-25T22:10:24.020ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 1b9ee4bd-b24d-41d8-8d4c-41fb278b93d2 file = nexus/db-queries/src/db/datastore/inventory.rs:1010
119282025-03-25T22:10:24.020ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 1b9ee4bd-b24d-41d8-8d4c-41fb278b93d2 time_started = 2025-03-25 22:10:23.542168 UTC
119292025-03-25T22:10:24.020ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Dependency
119302025-03-25T22:10:24.020ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.874799449s iteration = 3 status = {"collection_id":"1b9ee4bd-b24d-41d8-8d4c-41fb278b93d2","time_done":"2025-03-25 22:10:23.840334 UTC","time_started":"2025-03-25 22:10:23.542168 UTC"}
119312025-03-25T22:10:24.020ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 6 reason = Dependency
119322025-03-25T22:10:24.020ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
119332025-03-25T22:10:24.020ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
119342025-03-25T22:10:24.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
119352025-03-25T22:10:24.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
119362025-03-25T22:10:24.022ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119372025-03-25T22:10:24.022ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119382025-03-25T22:10:24.025ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
119392025-03-25T22:10:24.025ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
119402025-03-25T22:10:24.025ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
119412025-03-25T22:10:24.025ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
119422025-03-25T22:10:24.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
119432025-03-25T22:10:24.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 98686d70-e453-413a-9333-285688df6f6b roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
119442025-03-25T22:10:24.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
119452025-03-25T22:10:24.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 98686d70-e453-413a-9333-285688df6f6b resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
119462025-03-25T22:10:24.028ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
119472025-03-25T22:10:24.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
119482025-03-25T22:10:24.028ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
119492025-03-25T22:10:24.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
119502025-03-25T22:10:24.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2911 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 98686d70-e453-413a-9333-285688df6f6b response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
119512025-03-25T22:10:24.029ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119522025-03-25T22:10:24.031ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
119532025-03-25T22:10:24.031ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
119542025-03-25T22:10:24.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
119552025-03-25T22:10:24.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
119562025-03-25T22:10:24.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
119572025-03-25T22:10:24.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119582025-03-25T22:10:24.063ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
119592025-03-25T22:10:24.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
119602025-03-25T22:10:24.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
119612025-03-25T22:10:24.065ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119622025-03-25T22:10:24.066ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
119632025-03-25T22:10:24.066ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
119642025-03-25T22:10:24.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
119652025-03-25T22:10:24.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
119662025-03-25T22:10:24.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
119672025-03-25T22:10:24.070ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119682025-03-25T22:10:24.072ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
119692025-03-25T22:10:24.072ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
119702025-03-25T22:10:24.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
119712025-03-25T22:10:24.074ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119722025-03-25T22:10:24.075ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
119732025-03-25T22:10:24.075ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
119742025-03-25T22:10:24.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
119752025-03-25T22:10:24.077ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:113 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
119762025-03-25T22:10:24.077ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 57.675198ms iteration = 6 status = {"blueprint_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","inventory_collection_id":"1b9ee4bd-b24d-41d8-8d4c-41fb278b93d2","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
119772025-03-25T22:10:24.124ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 104.716009ms iteration = 24 status = {"physical_disks_added":0}
119782025-03-25T22:10:25.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = eeb720f2-16c6-4b25-8d71-1569ef889d42 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
119792025-03-25T22:10:25.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = eeb720f2-16c6-4b25-8d71-1569ef889d42 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
119802025-03-25T22:10:25.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2545 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = eeb720f2-16c6-4b25-8d71-1569ef889d42 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
119812025-03-25T22:10:26.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7a350555-6f10-41d0-8573-8c574c9afe23 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
119822025-03-25T22:10:26.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7a350555-6f10-41d0-8573-8c574c9afe23 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
119832025-03-25T22:10:26.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2528 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7a350555-6f10-41d0-8573-8c574c9afe23 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
119842025-03-25T22:10:27.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e38eaf08-d82e-4bf2-8678-dbd08c2098bc roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
119852025-03-25T22:10:27.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e38eaf08-d82e-4bf2-8678-dbd08c2098bc resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
119862025-03-25T22:10:27.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2304 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e38eaf08-d82e-4bf2-8678-dbd08c2098bc response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
119872025-03-25T22:10:28.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1aa3aef6-b2ca-4e8d-a6c0-40f0024f9da4 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
119882025-03-25T22:10:28.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1aa3aef6-b2ca-4e8d-a6c0-40f0024f9da4 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
119892025-03-25T22:10:28.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2160 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1aa3aef6-b2ca-4e8d-a6c0-40f0024f9da4 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
119902025-03-25T22:10:28.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39424 req_id = 3232a9f1-dbc2-4f02-bfaa-6b81a032108e roles = RoleSet { roles: {} } uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
119912025-03-25T22:10:28.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39424 req_id = 3232a9f1-dbc2-4f02-bfaa-6b81a032108e resource = Database result = Ok(()) uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
119922025-03-25T22:10:28.569ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3138 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39424 req_id = 3232a9f1-dbc2-4f02-bfaa-6b81a032108e response_code = 200 uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
119932025-03-25T22:10:28.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39424 req_id = 44cc347c-66f8-4240-a4de-3ea8e6604810 roles = RoleSet { roles: {} } uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
119942025-03-25T22:10:28.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39424 req_id = 44cc347c-66f8-4240-a4de-3ea8e6604810 resource = Database result = Ok(()) uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
119952025-03-25T22:10:28.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2657 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39424 req_id = 44cc347c-66f8-4240-a4de-3ea8e6604810 response_code = 200 uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
119962025-03-25T22:10:28.572ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 494 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = 62499182-0185-474e-9b14-865eef4617fa response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
119972025-03-25T22:10:29.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5aec56a5-fdd8-4181-81a8-2ac2b04b9121 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
119982025-03-25T22:10:29.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5aec56a5-fdd8-4181-81a8-2ac2b04b9121 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
119992025-03-25T22:10:29.138ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1644 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5aec56a5-fdd8-4181-81a8-2ac2b04b9121 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120002025-03-25T22:10:30.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 54e35304-3e77-4c2e-ad5e-d36a0e711858 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120012025-03-25T22:10:30.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 54e35304-3e77-4c2e-ad5e-d36a0e711858 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120022025-03-25T22:10:30.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2028 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 54e35304-3e77-4c2e-ad5e-d36a0e711858 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120032025-03-25T22:10:30.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
120042025-03-25T22:10:30.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120052025-03-25T22:10:30.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120062025-03-25T22:10:30.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
120072025-03-25T22:10:30.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
120082025-03-25T22:10:30.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
120092025-03-25T22:10:30.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120102025-03-25T22:10:30.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
120112025-03-25T22:10:30.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120122025-03-25T22:10:30.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120132025-03-25T22:10:30.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120142025-03-25T22:10:30.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120152025-03-25T22:10:30.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120162025-03-25T22:10:30.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
120172025-03-25T22:10:30.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120182025-03-25T22:10:30.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120192025-03-25T22:10:30.864ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
120202025-03-25T22:10:30.864ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.825334ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
120212025-03-25T22:10:30.884ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
120222025-03-25T22:10:30.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
120232025-03-25T22:10:30.915ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 71.249845ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
120242025-03-25T22:10:31.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e4a42ca4-73c1-469e-b15e-341233a26395 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120252025-03-25T22:10:31.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e4a42ca4-73c1-469e-b15e-341233a26395 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120262025-03-25T22:10:31.184ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2174 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e4a42ca4-73c1-469e-b15e-341233a26395 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120272025-03-25T22:10:32.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 78e2a0ec-8f1a-49d3-affc-1759fc968242 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120282025-03-25T22:10:32.204ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 78e2a0ec-8f1a-49d3-affc-1759fc968242 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120292025-03-25T22:10:32.206ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2009 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 78e2a0ec-8f1a-49d3-affc-1759fc968242 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120302025-03-25T22:10:33.225ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ffa274cd-6227-4873-88bf-1b3aae9f415f roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120312025-03-25T22:10:33.225ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ffa274cd-6227-4873-88bf-1b3aae9f415f resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120322025-03-25T22:10:33.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1689 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ffa274cd-6227-4873-88bf-1b3aae9f415f response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120332025-03-25T22:10:34.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3a7faa35-b386-495a-8911-865ad8a54018 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120342025-03-25T22:10:34.247ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3a7faa35-b386-495a-8911-865ad8a54018 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120352025-03-25T22:10:34.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2234 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3a7faa35-b386-495a-8911-865ad8a54018 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120362025-03-25T22:10:35.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4b0c65e1-c9f7-41fd-9a31-57911eb1b660 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120372025-03-25T22:10:35.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4b0c65e1-c9f7-41fd-9a31-57911eb1b660 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120382025-03-25T22:10:35.271ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2583 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4b0c65e1-c9f7-41fd-9a31-57911eb1b660 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120392025-03-25T22:10:36.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 16b45ca3-f2c3-443e-b191-18b6ed957a2b roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120402025-03-25T22:10:36.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 16b45ca3-f2c3-443e-b191-18b6ed957a2b resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120412025-03-25T22:10:36.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2200 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 16b45ca3-f2c3-443e-b191-18b6ed957a2b response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120422025-03-25T22:10:37.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 501e5f73-9afb-4d86-86c0-6690ebe44ab4 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120432025-03-25T22:10:37.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 501e5f73-9afb-4d86-86c0-6690ebe44ab4 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120442025-03-25T22:10:37.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2354 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 501e5f73-9afb-4d86-86c0-6690ebe44ab4 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120452025-03-25T22:10:38.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3157cb3c-3718-4da4-a1ca-3a7737a85237 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120462025-03-25T22:10:38.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3157cb3c-3718-4da4-a1ca-3a7737a85237 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120472025-03-25T22:10:38.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2052 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3157cb3c-3718-4da4-a1ca-3a7737a85237 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120482025-03-25T22:10:38.573ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 567 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = 8fe003dc-0e58-4d83-a1c6-25928fe92ad0 response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
120492025-03-25T22:10:39.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 18fddb88-23d2-47e3-ab36-7d123f6d7a64 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120502025-03-25T22:10:39.359ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 18fddb88-23d2-47e3-ab36-7d123f6d7a64 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120512025-03-25T22:10:39.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1903 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 18fddb88-23d2-47e3-ab36-7d123f6d7a64 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120522025-03-25T22:10:40.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2364a23e-46ed-46c7-afc4-c7fc6573a659 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120532025-03-25T22:10:40.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2364a23e-46ed-46c7-afc4-c7fc6573a659 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120542025-03-25T22:10:40.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2380 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2364a23e-46ed-46c7-afc4-c7fc6573a659 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120552025-03-25T22:10:40.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
120562025-03-25T22:10:40.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120572025-03-25T22:10:40.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120582025-03-25T22:10:40.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
120592025-03-25T22:10:40.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
120602025-03-25T22:10:40.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
120612025-03-25T22:10:40.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120622025-03-25T22:10:40.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
120632025-03-25T22:10:40.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120642025-03-25T22:10:40.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120652025-03-25T22:10:40.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120662025-03-25T22:10:40.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120672025-03-25T22:10:40.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120682025-03-25T22:10:40.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
120692025-03-25T22:10:40.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120702025-03-25T22:10:40.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120712025-03-25T22:10:40.865ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
120722025-03-25T22:10:40.865ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.928483ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
120732025-03-25T22:10:40.875ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
120742025-03-25T22:10:40.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
120752025-03-25T22:10:40.877ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.299414ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
120762025-03-25T22:10:41.404ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7ca7342f-ac1e-42ad-a757-7f630bc55d95 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120772025-03-25T22:10:41.404ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7ca7342f-ac1e-42ad-a757-7f630bc55d95 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120782025-03-25T22:10:41.406ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2407 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7ca7342f-ac1e-42ad-a757-7f630bc55d95 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120792025-03-25T22:10:42.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b3992cab-f64f-40b8-b07e-ae9995b55962 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120802025-03-25T22:10:42.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b3992cab-f64f-40b8-b07e-ae9995b55962 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120812025-03-25T22:10:42.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1732 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b3992cab-f64f-40b8-b07e-ae9995b55962 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120822025-03-25T22:10:43.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b0fa3e8c-8387-4b9a-9f33-a509edd159e3 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120832025-03-25T22:10:43.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b0fa3e8c-8387-4b9a-9f33-a509edd159e3 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120842025-03-25T22:10:43.449ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2009 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b0fa3e8c-8387-4b9a-9f33-a509edd159e3 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120852025-03-25T22:10:44.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d5aab4d4-7fb5-4344-8a2d-962cfc0f8520 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120862025-03-25T22:10:44.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d5aab4d4-7fb5-4344-8a2d-962cfc0f8520 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120872025-03-25T22:10:44.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2270 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d5aab4d4-7fb5-4344-8a2d-962cfc0f8520 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120882025-03-25T22:10:45.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 862f82fa-565d-45f4-8236-bbe678a6f935 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120892025-03-25T22:10:45.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 862f82fa-565d-45f4-8236-bbe678a6f935 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120902025-03-25T22:10:45.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2316 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 862f82fa-565d-45f4-8236-bbe678a6f935 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120912025-03-25T22:10:46.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 749d84d1-ac47-4f6e-8878-5520ed81be9b roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120922025-03-25T22:10:46.515ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 749d84d1-ac47-4f6e-8878-5520ed81be9b resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120932025-03-25T22:10:46.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2103 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 749d84d1-ac47-4f6e-8878-5520ed81be9b response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120942025-03-25T22:10:47.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 45f391a0-e72c-459b-9135-2b35798a7065 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120952025-03-25T22:10:47.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 45f391a0-e72c-459b-9135-2b35798a7065 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120962025-03-25T22:10:47.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1817 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 45f391a0-e72c-459b-9135-2b35798a7065 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120972025-03-25T22:10:48.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 9904d592-02f2-404b-ad0e-70a9137bb471 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120982025-03-25T22:10:48.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 9904d592-02f2-404b-ad0e-70a9137bb471 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
120992025-03-25T22:10:48.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2588 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 9904d592-02f2-404b-ad0e-70a9137bb471 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
121002025-03-25T22:10:48.574ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 595 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = e7c1f4c9-98e9-41a4-bde2-a3d4dab54f1d response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
121012025-03-25T22:10:49.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f1059f68-d52d-4a42-9bf8-ffcbebc9253b roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
121022025-03-25T22:10:49.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f1059f68-d52d-4a42-9bf8-ffcbebc9253b resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
121032025-03-25T22:10:49.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3606 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f1059f68-d52d-4a42-9bf8-ffcbebc9253b response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
121042025-03-25T22:10:50.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 805b73c5-a354-40d6-9a68-c705b67a9743 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
121052025-03-25T22:10:50.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 805b73c5-a354-40d6-9a68-c705b67a9743 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
121062025-03-25T22:10:50.628ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3531 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 805b73c5-a354-40d6-9a68-c705b67a9743 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
121072025-03-25T22:10:50.843ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
121082025-03-25T22:10:50.843ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
121092025-03-25T22:10:50.843ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
121102025-03-25T22:10:50.843ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
121112025-03-25T22:10:50.843ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
121122025-03-25T22:10:50.843ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
121132025-03-25T22:10:50.843ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
121142025-03-25T22:10:50.843ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121152025-03-25T22:10:50.843ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
121162025-03-25T22:10:50.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
121172025-03-25T22:10:50.843ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
121182025-03-25T22:10:50.843ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 22 reason = Timeout
121192025-03-25T22:10:50.843ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
121202025-03-25T22:10:50.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121212025-03-25T22:10:50.843ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
121222025-03-25T22:10:50.843ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Timeout
121232025-03-25T22:10:50.843ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
121242025-03-25T22:10:50.843ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
121252025-03-25T22:10:50.843ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
121262025-03-25T22:10:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
121272025-03-25T22:10:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
121282025-03-25T22:10:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
121292025-03-25T22:10:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
121302025-03-25T22:10:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
121312025-03-25T22:10:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
121322025-03-25T22:10:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121332025-03-25T22:10:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121342025-03-25T22:10:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
121352025-03-25T22:10:50.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
121362025-03-25T22:10:50.845ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
121372025-03-25T22:10:50.845ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
121382025-03-25T22:10:50.845ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
121392025-03-25T22:10:50.845ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 22 reason = Timeout
121402025-03-25T22:10:50.845ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
121412025-03-25T22:10:50.845ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
121422025-03-25T22:10:50.845ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
121432025-03-25T22:10:50.845ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
121442025-03-25T22:10:50.845ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
121452025-03-25T22:10:50.845ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
121462025-03-25T22:10:50.845ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
121472025-03-25T22:10:50.845ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
121482025-03-25T22:10:50.845ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
121492025-03-25T22:10:50.845ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
121502025-03-25T22:10:50.845ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
121512025-03-25T22:10:50.845ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
121522025-03-25T22:10:50.845ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
121532025-03-25T22:10:50.845ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
121542025-03-25T22:10:50.845ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
121552025-03-25T22:10:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
121562025-03-25T22:10:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
121572025-03-25T22:10:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
121582025-03-25T22:10:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
121592025-03-25T22:10:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
121602025-03-25T22:10:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
121612025-03-25T22:10:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
121622025-03-25T22:10:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
121632025-03-25T22:10:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
121642025-03-25T22:10:50.848ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.205233ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
121652025-03-25T22:10:50.848ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121662025-03-25T22:10:50.848ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6804, tv_nsec: 184049894 } })
121672025-03-25T22:10:50.848ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1171
121682025-03-25T22:10:50.848ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121692025-03-25T22:10:50.850ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121702025-03-25T22:10:50.850ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6804, tv_nsec: 186318663 } })
121712025-03-25T22:10:50.850ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121722025-03-25T22:10:50.850ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1171
121732025-03-25T22:10:50.851ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
121742025-03-25T22:10:50.851ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
121752025-03-25T22:10:50.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
121762025-03-25T22:10:50.851ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
121772025-03-25T22:10:50.851ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
121782025-03-25T22:10:50.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
121792025-03-25T22:10:50.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121802025-03-25T22:10:50.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
121812025-03-25T22:10:50.853ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121822025-03-25T22:10:50.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121832025-03-25T22:10:50.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
121842025-03-25T22:10:50.853ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
121852025-03-25T22:10:50.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
121862025-03-25T22:10:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
121872025-03-25T22:10:50.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121882025-03-25T22:10:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121892025-03-25T22:10:50.859ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121902025-03-25T22:10:50.862ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
121912025-03-25T22:10:50.862ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
121922025-03-25T22:10:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
121932025-03-25T22:10:50.872ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
121942025-03-25T22:10:50.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
121952025-03-25T22:10:50.873ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
121962025-03-25T22:10:50.873ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121972025-03-25T22:10:50.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
121982025-03-25T22:10:50.873ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6804, tv_nsec: 209324465 } })
121992025-03-25T22:10:50.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122002025-03-25T22:10:50.874ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122012025-03-25T22:10:50.874ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1171 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
122022025-03-25T22:10:50.875ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
122032025-03-25T22:10:50.875ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122042025-03-25T22:10:50.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122052025-03-25T22:10:50.910ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
122062025-03-25T22:10:50.910ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
122072025-03-25T22:10:50.910ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
122082025-03-25T22:10:50.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
122092025-03-25T22:10:50.912ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
122102025-03-25T22:10:50.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
122112025-03-25T22:10:50.913ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 68.591089ms iteration = 22 status = {"errors":[],"requests_created_ok":[]}
122122025-03-25T22:10:50.915ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 69.950192ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
122132025-03-25T22:10:50.920ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
122142025-03-25T22:10:50.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
122152025-03-25T22:10:50.923ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
122162025-03-25T22:10:50.924ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
122172025-03-25T22:10:50.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
122182025-03-25T22:10:50.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
122192025-03-25T22:10:50.925ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 80.597248ms iteration = 22 status = {"errors":[],"finish_invoked_ok":[]}
122202025-03-25T22:10:50.927ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122212025-03-25T22:10:50.928ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
122222025-03-25T22:10:50.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
122232025-03-25T22:10:50.930ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f034aaf6-2037-4cb4-8409-3ab31c15cc28, lookup_type: ById(f034aaf6-2037-4cb4-8409-3ab31c15cc28) } result = Ok(())
122242025-03-25T22:10:50.930ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
122252025-03-25T22:10:50.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
122262025-03-25T22:10:50.930ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
122272025-03-25T22:10:50.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
122282025-03-25T22:10:50.932ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 89.032076ms iteration = 22 status = 0
122292025-03-25T22:10:50.934ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122302025-03-25T22:10:50.937ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122312025-03-25T22:10:50.937ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
122322025-03-25T22:10:50.937ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
122332025-03-25T22:10:50.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
122342025-03-25T22:10:50.939ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
122352025-03-25T22:10:50.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
122362025-03-25T22:10:50.940ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
122372025-03-25T22:10:50.940ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
122382025-03-25T22:10:50.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
122392025-03-25T22:10:50.942ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122402025-03-25T22:10:50.945ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
122412025-03-25T22:10:50.945ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122422025-03-25T22:10:50.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122432025-03-25T22:10:50.959ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
122442025-03-25T22:10:50.959ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
122452025-03-25T22:10:50.960ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d0482ea7-56ac-49bb-a903-9e6daba303e5", "content-length": "26", "date": "Tue, 25 Mar 2025 22:10:50 GMT"} })
122462025-03-25T22:10:50.960ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
122472025-03-25T22:10:50.962ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
122482025-03-25T22:10:50.969ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
122492025-03-25T22:10:50.969ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
122502025-03-25T22:10:50.969ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
122512025-03-25T22:10:50.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
122522025-03-25T22:10:50.971ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 127.448397ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
122532025-03-25T22:10:50.974ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
122542025-03-25T22:10:50.974ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 130.915477ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
122552025-03-25T22:10:50.980ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
122562025-03-25T22:10:50.980ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
122572025-03-25T22:10:50.980ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9671e8ca-d3c8-40f5-bc23-a814c7c56714", "content-length": "26", "date": "Tue, 25 Mar 2025 22:10:50 GMT"} })
122582025-03-25T22:10:50.980ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
122592025-03-25T22:10:50.983ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
122602025-03-25T22:10:50.984ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 zone_address = fd00:1122:3344:101::2
122612025-03-25T22:10:50.984ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
122622025-03-25T22:10:50.984ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f471908a-0323-4e07-a2a8-fbb563c60e60", "content-length": "26", "date": "Tue, 25 Mar 2025 22:10:50 GMT"} })
122632025-03-25T22:10:50.984ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1184 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
122642025-03-25T22:10:50.986ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
122652025-03-25T22:10:50.992ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 147.984425ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
122662025-03-25T22:10:50.995ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
122672025-03-25T22:10:50.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
122682025-03-25T22:10:50.997ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 152.393212ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
122692025-03-25T22:10:51.002ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122702025-03-25T22:10:51.005ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
122712025-03-25T22:10:51.005ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
122722025-03-25T22:10:51.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
122732025-03-25T22:10:51.013ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
122742025-03-25T22:10:51.013ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
122752025-03-25T22:10:51.013ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 168.397561ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
122762025-03-25T22:10:51.036ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
122772025-03-25T22:10:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
122782025-03-25T22:10:51.036ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 191.874621ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
122792025-03-25T22:10:51.048ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 204.93878ms iteration = 22 status = {}
122802025-03-25T22:10:51.088ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 244.045463ms iteration = 25 status = {"physical_disks_added":0}
122812025-03-25T22:10:51.100ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
122822025-03-25T22:10:51.100ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "2dabb75b-b385-4d21-a6c0-1746f29745e0", "content-length": "1", "date": "Tue, 25 Mar 2025 22:10:50 GMT"} })
122832025-03-25T22:10:51.103ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
122842025-03-25T22:10:51.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
122852025-03-25T22:10:51.124ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/bf47b3f0-835f-454a-8f60-83602eb93554/state
122862025-03-25T22:10:51.145ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
122872025-03-25T22:10:51.145ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
122882025-03-25T22:10:51.146ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a0365805-b774-4b5c-83f2-ae459aa65544", "content-length": "523", "date": "Tue, 25 Mar 2025 22:10:51 GMT"} })
122892025-03-25T22:10:51.146ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122902025-03-25T22:10:51.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122912025-03-25T22:10:51.149ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 305.907214ms iteration = 22 status = null
122922025-03-25T22:10:51.171ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:360
122932025-03-25T22:10:51.171ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 327.269597ms iteration = 22 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
122942025-03-25T22:10:51.197ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
122952025-03-25T22:10:51.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
122962025-03-25T22:10:51.201ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a5db250-fa3f-4168-ab16-5c36568c22e2, rack_id: c7210e4b-5a81-4ec8-b8fe-816a9508dc74, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(6d5dda50-e3c4-4853-9bfa-a66b447ab351) } rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
122972025-03-25T22:10:51.201ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
122982025-03-25T22:10:51.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
122992025-03-25T22:10:51.215ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {51c96537-3876-409e-8967-6e6cd1c05921: {10.151.2.176: {7797b4f0-9b76-4135-b55c-23637b7be801}, 10.151.2.175: {7797b4f0-9b76-4135-b55c-23637b7be801}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
123002025-03-25T22:10:51.215ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
123012025-03-25T22:10:51.217ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
123022025-03-25T22:10:51.217ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "df963487-9f00-4dfe-9442-972ca1f4787d", "content-length": "134", "date": "Tue, 25 Mar 2025 22:10:50 GMT"} })
123032025-03-25T22:10:51.217ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
123042025-03-25T22:10:51.217ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 6d5dda50-e3c4-4853-9bfa-a66b447ab351
123052025-03-25T22:10:51.217ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "bbfdccdf-f618-4522-85ed-86a148def600", "date": "Tue, 25 Mar 2025 22:10:51 GMT"} })
123062025-03-25T22:10:51.217ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123072025-03-25T22:10:51.218ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
123082025-03-25T22:10:51.218ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
123092025-03-25T22:10:51.218ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
123102025-03-25T22:10:51.218ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
123112025-03-25T22:10:51.218ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
123122025-03-25T22:10:51.218ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
123132025-03-25T22:10:51.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123142025-03-25T22:10:51.218ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
123152025-03-25T22:10:51.218ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
123162025-03-25T22:10:51.218ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
123172025-03-25T22:10:51.218ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123182025-03-25T22:10:51.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123192025-03-25T22:10:51.220ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123202025-03-25T22:10:51.221ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
123212025-03-25T22:10:51.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123222025-03-25T22:10:51.221ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8bfbb46b-4071-44f9-a913-be23e3e3314b", "content-length": "2", "date": "Tue, 25 Mar 2025 22:10:50 GMT"} })
123232025-03-25T22:10:51.221ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
123242025-03-25T22:10:51.221ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c3389b9-a3bb-40bc-9918-872ebb45792c", "content-length": "52", "date": "Tue, 25 Mar 2025 22:10:50 GMT"} })
123252025-03-25T22:10:51.221ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
123262025-03-25T22:10:51.221ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
123272025-03-25T22:10:51.224ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123282025-03-25T22:10:51.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123292025-03-25T22:10:51.228ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123302025-03-25T22:10:51.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123312025-03-25T22:10:51.231ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123322025-03-25T22:10:51.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123332025-03-25T22:10:51.238ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123342025-03-25T22:10:51.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123352025-03-25T22:10:51.242ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
123362025-03-25T22:10:51.242ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123372025-03-25T22:10:51.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123382025-03-25T22:10:51.245ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123392025-03-25T22:10:51.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123402025-03-25T22:10:51.247ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123412025-03-25T22:10:51.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123422025-03-25T22:10:51.250ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123432025-03-25T22:10:51.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123442025-03-25T22:10:51.252ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123452025-03-25T22:10:51.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123462025-03-25T22:10:51.291ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123472025-03-25T22:10:51.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123482025-03-25T22:10:51.292ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
123492025-03-25T22:10:51.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
123502025-03-25T22:10:51.293ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123512025-03-25T22:10:51.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123522025-03-25T22:10:51.295ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123532025-03-25T22:10:51.299ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, lookup_type: ById(5c35ff8c-21dd-48b9-9751-76bfa681bc38) }, key: 8d0ea42b-d77d-424d-a7af-1db382bd9f03, lookup_type: ById(8d0ea42b-d77d-424d-a7af-1db382bd9f03) }, key: f1b39d8c-6f2b-4343-a077-29f471cdeb1e, lookup_type: ById(f1b39d8c-6f2b-4343-a077-29f471cdeb1e) }, key: a9b52b9b-3b57-4a0e-8758-03d08c794bfa, lookup_type: ById(a9b52b9b-3b57-4a0e-8758-03d08c794bfa) } result = Ok(())
123542025-03-25T22:10:51.300ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123552025-03-25T22:10:51.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123562025-03-25T22:10:51.302ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123572025-03-25T22:10:51.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123582025-03-25T22:10:51.304ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123592025-03-25T22:10:51.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123602025-03-25T22:10:51.305ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123612025-03-25T22:10:51.310ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, lookup_type: ById(5c35ff8c-21dd-48b9-9751-76bfa681bc38) }, key: 8d0ea42b-d77d-424d-a7af-1db382bd9f03, lookup_type: ById(8d0ea42b-d77d-424d-a7af-1db382bd9f03) }, key: f1b39d8c-6f2b-4343-a077-29f471cdeb1e, lookup_type: ById(f1b39d8c-6f2b-4343-a077-29f471cdeb1e) }, key: a9b52b9b-3b57-4a0e-8758-03d08c794bfa, lookup_type: ById(a9b52b9b-3b57-4a0e-8758-03d08c794bfa) } result = Ok(())
123622025-03-25T22:10:51.310ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123632025-03-25T22:10:51.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123642025-03-25T22:10:51.317ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123652025-03-25T22:10:51.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123662025-03-25T22:10:51.320ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123672025-03-25T22:10:51.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123682025-03-25T22:10:51.322ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123692025-03-25T22:10:51.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123702025-03-25T22:10:51.325ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123712025-03-25T22:10:51.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123722025-03-25T22:10:51.327ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123732025-03-25T22:10:51.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123742025-03-25T22:10:51.342ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123752025-03-25T22:10:51.344ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
123762025-03-25T22:10:51.344ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
123772025-03-25T22:10:51.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
123782025-03-25T22:10:51.346ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123792025-03-25T22:10:51.348ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
123802025-03-25T22:10:51.348ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
123812025-03-25T22:10:51.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
123822025-03-25T22:10:51.363ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "438d9bd1-ae3e-464f-9163-950a9de8ab9c", "date": "Tue, 25 Mar 2025 22:10:51 GMT"} })
123832025-03-25T22:10:51.363ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch = Switch0
123842025-03-25T22:10:51.363ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
123852025-03-25T22:10:51.364ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "65946f94-57c2-4140-b32c-5e4b8b402c73", "content-length": "682", "date": "Tue, 25 Mar 2025 22:10:51 GMT"} })
123862025-03-25T22:10:51.364ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123872025-03-25T22:10:51.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123882025-03-25T22:10:51.367ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123892025-03-25T22:10:51.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123902025-03-25T22:10:51.368ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123912025-03-25T22:10:51.368ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123922025-03-25T22:10:51.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123932025-03-25T22:10:51.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123942025-03-25T22:10:51.370ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123952025-03-25T22:10:51.372ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123962025-03-25T22:10:51.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123972025-03-25T22:10:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, lookup_type: ById(5c35ff8c-21dd-48b9-9751-76bfa681bc38) }, key: 8d0ea42b-d77d-424d-a7af-1db382bd9f03, lookup_type: ById(8d0ea42b-d77d-424d-a7af-1db382bd9f03) }, key: f1b39d8c-6f2b-4343-a077-29f471cdeb1e, lookup_type: ById(f1b39d8c-6f2b-4343-a077-29f471cdeb1e) }, key: e60830c8-7167-4dd1-b27a-ea37faa8b110, lookup_type: ById(e60830c8-7167-4dd1-b27a-ea37faa8b110) } result = Ok(())
123982025-03-25T22:10:51.374ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123992025-03-25T22:10:51.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124002025-03-25T22:10:51.375ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124012025-03-25T22:10:51.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124022025-03-25T22:10:51.376ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124032025-03-25T22:10:51.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124042025-03-25T22:10:51.378ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124052025-03-25T22:10:51.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124062025-03-25T22:10:51.380ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124072025-03-25T22:10:51.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124082025-03-25T22:10:51.383ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124092025-03-25T22:10:51.383ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 540.108975ms iteration = 22 status = {}
124102025-03-25T22:10:51.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124112025-03-25T22:10:51.385ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124122025-03-25T22:10:51.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124132025-03-25T22:10:51.387ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124142025-03-25T22:10:51.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124152025-03-25T22:10:51.388ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124162025-03-25T22:10:51.393ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, lookup_type: ById(5c35ff8c-21dd-48b9-9751-76bfa681bc38) }, key: 8d0ea42b-d77d-424d-a7af-1db382bd9f03, lookup_type: ById(8d0ea42b-d77d-424d-a7af-1db382bd9f03) }, key: f1b39d8c-6f2b-4343-a077-29f471cdeb1e, lookup_type: ById(f1b39d8c-6f2b-4343-a077-29f471cdeb1e) }, key: e60830c8-7167-4dd1-b27a-ea37faa8b110, lookup_type: ByName("default") } result = Ok(())
124172025-03-25T22:10:51.393ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124182025-03-25T22:10:51.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124192025-03-25T22:10:51.395ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124202025-03-25T22:10:51.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124212025-03-25T22:10:51.397ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124222025-03-25T22:10:51.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124232025-03-25T22:10:51.399ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124242025-03-25T22:10:51.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124252025-03-25T22:10:51.402ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124262025-03-25T22:10:51.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124272025-03-25T22:10:51.404ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124282025-03-25T22:10:51.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124292025-03-25T22:10:51.406ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124302025-03-25T22:10:51.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124312025-03-25T22:10:51.449ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124322025-03-25T22:10:51.453ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = InternetGateway { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, lookup_type: ById(5c35ff8c-21dd-48b9-9751-76bfa681bc38) }, key: 8d0ea42b-d77d-424d-a7af-1db382bd9f03, lookup_type: ById(8d0ea42b-d77d-424d-a7af-1db382bd9f03) }, key: f1b39d8c-6f2b-4343-a077-29f471cdeb1e, lookup_type: ById(f1b39d8c-6f2b-4343-a077-29f471cdeb1e) }, key: 7797b4f0-9b76-4135-b55c-23637b7be801, lookup_type: ByName("default") } result = Ok(())
124332025-03-25T22:10:51.453ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
124342025-03-25T22:10:51.454ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "bc93079f-1007-4996-8136-3ded16970d6d", "date": "Tue, 25 Mar 2025 22:10:51 GMT"} })
124352025-03-25T22:10:51.456ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 611.38925ms iteration = 22 status = {}
124362025-03-25T22:10:51.473ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
124372025-03-25T22:10:51.477ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "fca15ecd-3e8e-460e-b49d-e457d673ad7c", "content-length": "810", "date": "Tue, 25 Mar 2025 22:10:51 GMT"} })
124382025-03-25T22:10:51.480ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(4754106) }} sled = sock
124392025-03-25T22:10:51.480ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
124402025-03-25T22:10:51.480ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
124412025-03-25T22:10:51.481ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 637.812772ms iteration = 22 status = {}
124422025-03-25T22:10:51.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = dbcee80e-94e7-4478-8f88-440e1d6fc535 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
124432025-03-25T22:10:51.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = dbcee80e-94e7-4478-8f88-440e1d6fc535 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
124442025-03-25T22:10:51.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3544 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = dbcee80e-94e7-4478-8f88-440e1d6fc535 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
124452025-03-25T22:10:52.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8d52927a-18ad-4826-a190-b6dd9b5f686e roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
124462025-03-25T22:10:52.683ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8d52927a-18ad-4826-a190-b6dd9b5f686e resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
124472025-03-25T22:10:52.685ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3011 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8d52927a-18ad-4826-a190-b6dd9b5f686e response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
124482025-03-25T22:10:53.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b08219b8-3230-4842-8f83-b270f7367606 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
124492025-03-25T22:10:53.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b08219b8-3230-4842-8f83-b270f7367606 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
124502025-03-25T22:10:53.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2533 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b08219b8-3230-4842-8f83-b270f7367606 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
124512025-03-25T22:10:54.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e571469c-bfe4-4372-81f3-9cac3aa95ce7 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
124522025-03-25T22:10:54.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e571469c-bfe4-4372-81f3-9cac3aa95ce7 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
124532025-03-25T22:10:54.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2593 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e571469c-bfe4-4372-81f3-9cac3aa95ce7 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
124542025-03-25T22:10:55.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e7e493be-e854-44f6-b70c-3a9e6f622ced roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
124552025-03-25T22:10:55.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e7e493be-e854-44f6-b70c-3a9e6f622ced resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
124562025-03-25T22:10:55.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2220 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e7e493be-e854-44f6-b70c-3a9e6f622ced response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
124572025-03-25T22:10:56.318ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/bf47b3f0-835f-454a-8f60-83602eb93554/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c628da2-19b4-4a99-81df-2cc72057bb61", "content-length": "131", "date": "Tue, 25 Mar 2025 22:10:56 GMT"} })
124582025-03-25T22:10:56.323ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-03-25T22:10:48.035923597Z }, migration_in: None, migration_out: None } vmm_id = bf47b3f0-835f-454a-8f60-83602eb93554
124592025-03-25T22:10:56.323ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2088 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = bf47b3f0-835f-454a-8f60-83602eb93554 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 vmm_id = bf47b3f0-835f-454a-8f60-83602eb93554 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-03-25T22:10:48.035923597Z }
124602025-03-25T22:10:56.323ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d roles = RoleSet { roles: {} } sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 vmm_id = bf47b3f0-835f-454a-8f60-83602eb93554
124612025-03-25T22:10:56.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d resource = Database result = Ok(()) sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 vmm_id = bf47b3f0-835f-454a-8f60-83602eb93554
124622025-03-25T22:10:56.334ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2088 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = bf47b3f0-835f-454a-8f60-83602eb93554 remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0459f68c-13a0-4f8e-97c9-46a0157a0103 uri = /vmms/bf47b3f0-835f-454a-8f60-83602eb93554 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-03-25T22:10:56.319401933Z }
124632025-03-25T22:10:56.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0459f68c-13a0-4f8e-97c9-46a0157a0103 roles = RoleSet { roles: {} } uri = /vmms/bf47b3f0-835f-454a-8f60-83602eb93554
124642025-03-25T22:10:56.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0459f68c-13a0-4f8e-97c9-46a0157a0103 resource = Database result = Ok(()) uri = /vmms/bf47b3f0-835f-454a-8f60-83602eb93554
124652025-03-25T22:10:56.383ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
124662025-03-25T22:10:56.385ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 5.540155506s iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"starting":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
124672025-03-25T22:10:56.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 72064 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0459f68c-13a0-4f8e-97c9-46a0157a0103 response_code = 204 uri = /vmms/bf47b3f0-835f-454a-8f60-83602eb93554
124682025-03-25T22:10:56.392ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2088 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = bf47b3f0-835f-454a-8f60-83602eb93554 remote_addr = [fd00:1122:3344:101::1]:57063 req_id = aa1046ea-c5fe-4df2-a8a0-86f2e651d1ca uri = /vmms/bf47b3f0-835f-454a-8f60-83602eb93554 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-03-25T22:10:56.392205925Z }
124692025-03-25T22:10:56.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57063 req_id = aa1046ea-c5fe-4df2-a8a0-86f2e651d1ca roles = RoleSet { roles: {} } uri = /vmms/bf47b3f0-835f-454a-8f60-83602eb93554
124702025-03-25T22:10:56.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57063 req_id = aa1046ea-c5fe-4df2-a8a0-86f2e651d1ca resource = Database result = Ok(()) uri = /vmms/bf47b3f0-835f-454a-8f60-83602eb93554
124712025-03-25T22:10:56.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 11078 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57063 req_id = aa1046ea-c5fe-4df2-a8a0-86f2e651d1ca response_code = 204 uri = /vmms/bf47b3f0-835f-454a-8f60-83602eb93554
124722025-03-25T22:10:56.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5eccc0b3-4069-48d2-89e8-d6f4551d0db1 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
124732025-03-25T22:10:56.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5eccc0b3-4069-48d2-89e8-d6f4551d0db1 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
124742025-03-25T22:10:56.774ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2154 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5eccc0b3-4069-48d2-89e8-d6f4551d0db1 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
124752025-03-25T22:10:57.795ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 13c8b0a6-7892-40b2-bc16-7aaf1f1de59e roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
124762025-03-25T22:10:57.795ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 13c8b0a6-7892-40b2-bc16-7aaf1f1de59e resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
124772025-03-25T22:10:57.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2021 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 13c8b0a6-7892-40b2-bc16-7aaf1f1de59e response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
124782025-03-25T22:10:58.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39424 req_id = 1ae8b4fb-9ea7-414f-a25b-8e5702f32551 roles = RoleSet { roles: {} } uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
124792025-03-25T22:10:58.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39424 req_id = 1ae8b4fb-9ea7-414f-a25b-8e5702f32551 resource = Database result = Ok(()) uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
124802025-03-25T22:10:58.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2740 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39424 req_id = 1ae8b4fb-9ea7-414f-a25b-8e5702f32551 response_code = 200 uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
124812025-03-25T22:10:58.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39424 req_id = 40504de4-2f24-4ef1-8d96-5415d5cda22c roles = RoleSet { roles: {} } uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
124822025-03-25T22:10:58.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39424 req_id = 40504de4-2f24-4ef1-8d96-5415d5cda22c resource = Database result = Ok(()) uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
124832025-03-25T22:10:58.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4370 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39424 req_id = 40504de4-2f24-4ef1-8d96-5415d5cda22c response_code = 200 uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
124842025-03-25T22:10:58.576ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3086 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = ff3b69ed-b4c9-4627-b491-4a6252e203ca response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
124852025-03-25T22:10:58.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 243ff80c-df12-4d20-b3b2-5dffb51e5953 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
124862025-03-25T22:10:58.817ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 243ff80c-df12-4d20-b3b2-5dffb51e5953 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
124872025-03-25T22:10:58.819ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2278 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 243ff80c-df12-4d20-b3b2-5dffb51e5953 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
124882025-03-25T22:10:59.839ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 95b8e3bb-95c4-4c64-be0d-2a0704aaa865 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
124892025-03-25T22:10:59.840ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 95b8e3bb-95c4-4c64-be0d-2a0704aaa865 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
124902025-03-25T22:10:59.842ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2824 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 95b8e3bb-95c4-4c64-be0d-2a0704aaa865 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
124912025-03-25T22:11:00.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
124922025-03-25T22:11:00.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124932025-03-25T22:11:00.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124942025-03-25T22:11:00.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
124952025-03-25T22:11:00.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
124962025-03-25T22:11:00.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
124972025-03-25T22:11:00.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124982025-03-25T22:11:00.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
124992025-03-25T22:11:00.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125002025-03-25T22:11:00.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125012025-03-25T22:11:00.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125022025-03-25T22:11:00.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125032025-03-25T22:11:00.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125042025-03-25T22:11:00.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
125052025-03-25T22:11:00.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125062025-03-25T22:11:00.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125072025-03-25T22:11:00.861ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0c1aa10d-ccf4-45a2-88d4-2ad1b285f18b roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
125082025-03-25T22:11:00.861ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0c1aa10d-ccf4-45a2-88d4-2ad1b285f18b resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
125092025-03-25T22:11:00.863ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1388 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0c1aa10d-ccf4-45a2-88d4-2ad1b285f18b response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
125102025-03-25T22:11:00.864ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
125112025-03-25T22:11:00.864ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.088989ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
125122025-03-25T22:11:00.873ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
125132025-03-25T22:11:00.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
125142025-03-25T22:11:00.901ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.118437ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
125152025-03-25T22:11:01.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = bda9b9ab-f542-47f2-9339-893b4f350c34 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
125162025-03-25T22:11:01.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = bda9b9ab-f542-47f2-9339-893b4f350c34 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
125172025-03-25T22:11:01.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2375 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = bda9b9ab-f542-47f2-9339-893b4f350c34 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
125182025-03-25T22:11:02.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a897049c-1df3-4874-835e-2c6ed9ad31b8 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
125192025-03-25T22:11:02.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a897049c-1df3-4874-835e-2c6ed9ad31b8 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
125202025-03-25T22:11:02.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5265 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a897049c-1df3-4874-835e-2c6ed9ad31b8 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
125212025-03-25T22:11:03.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4600c423-f961-4daf-a6d5-486e95f8f14a roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
125222025-03-25T22:11:03.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4600c423-f961-4daf-a6d5-486e95f8f14a resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
125232025-03-25T22:11:03.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2573 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4600c423-f961-4daf-a6d5-486e95f8f14a response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
125242025-03-25T22:11:04.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ad9051f7-0bfa-4fc6-b40d-25cb6c7a4c1e roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
125252025-03-25T22:11:04.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ad9051f7-0bfa-4fc6-b40d-25cb6c7a4c1e resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
125262025-03-25T22:11:04.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2248 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ad9051f7-0bfa-4fc6-b40d-25cb6c7a4c1e response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
125272025-03-25T22:11:05.721ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2088 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = bf47b3f0-835f-454a-8f60-83602eb93554 remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5003db67-e688-4ae1-acaa-eab30698457e uri = /vmms/bf47b3f0-835f-454a-8f60-83602eb93554 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-03-25T22:11:05.720904188Z }
125282025-03-25T22:11:05.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5003db67-e688-4ae1-acaa-eab30698457e roles = RoleSet { roles: {} } uri = /vmms/bf47b3f0-835f-454a-8f60-83602eb93554
125292025-03-25T22:11:05.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5003db67-e688-4ae1-acaa-eab30698457e resource = Database result = Ok(()) uri = /vmms/bf47b3f0-835f-454a-8f60-83602eb93554
125302025-03-25T22:11:05.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 21982 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5003db67-e688-4ae1-acaa-eab30698457e response_code = 204 uri = /vmms/bf47b3f0-835f-454a-8f60-83602eb93554
125312025-03-25T22:11:05.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a5fb031f-9e20-42b4-aa21-5a56f1fc6aa8 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
125322025-03-25T22:11:05.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a5fb031f-9e20-42b4-aa21-5a56f1fc6aa8 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
125332025-03-25T22:11:05.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2132 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a5fb031f-9e20-42b4-aa21-5a56f1fc6aa8 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
125342025-03-25T22:11:07.001ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e3f5cfb7-85b4-4089-ada7-ecf7894beb0d roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
125352025-03-25T22:11:07.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e3f5cfb7-85b4-4089-ada7-ecf7894beb0d resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
125362025-03-25T22:11:07.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2527 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e3f5cfb7-85b4-4089-ada7-ecf7894beb0d response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
125372025-03-25T22:11:08.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c6fe01ab-9143-460f-9c39-8266c0765905 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
125382025-03-25T22:11:08.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c6fe01ab-9143-460f-9c39-8266c0765905 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
125392025-03-25T22:11:08.026ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2317 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c6fe01ab-9143-460f-9c39-8266c0765905 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
125402025-03-25T22:11:08.159ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2088 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = bf47b3f0-835f-454a-8f60-83602eb93554 remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ad33fa37-82b3-45bd-9033-cdf0b1870dc7 uri = /vmms/bf47b3f0-835f-454a-8f60-83602eb93554 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-03-25T22:11:08.159385993Z }
125412025-03-25T22:11:08.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ad33fa37-82b3-45bd-9033-cdf0b1870dc7 roles = RoleSet { roles: {} } uri = /vmms/bf47b3f0-835f-454a-8f60-83602eb93554
125422025-03-25T22:11:08.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ad33fa37-82b3-45bd-9033-cdf0b1870dc7 resource = Database result = Ok(()) uri = /vmms/bf47b3f0-835f-454a-8f60-83602eb93554
125432025-03-25T22:11:08.207ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = bf47b3f0-835f-454a-8f60-83602eb93554 remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ad33fa37-82b3-45bd-9033-cdf0b1870dc7 uri = /vmms/bf47b3f0-835f-454a-8f60-83602eb93554 vmm_needs_update = true
125442025-03-25T22:11:08.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ad33fa37-82b3-45bd-9033-cdf0b1870dc7 roles = RoleSet { roles: {} } uri = /vmms/bf47b3f0-835f-454a-8f60-83602eb93554
125452025-03-25T22:11:08.208ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ad33fa37-82b3-45bd-9033-cdf0b1870dc7 resource = Database result = Ok(()) uri = /vmms/bf47b3f0-835f-454a-8f60-83602eb93554
125462025-03-25T22:11:08.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ad33fa37-82b3-45bd-9033-cdf0b1870dc7 roles = RoleSet { roles: {} } uri = /vmms/bf47b3f0-835f-454a-8f60-83602eb93554
125472025-03-25T22:11:08.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ad33fa37-82b3-45bd-9033-cdf0b1870dc7 resource = Database result = Ok(()) uri = /vmms/bf47b3f0-835f-454a-8f60-83602eb93554
125482025-03-25T22:11:08.212ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ad33fa37-82b3-45bd-9033-cdf0b1870dc7 roles = RoleSet { roles: {} } uri = /vmms/bf47b3f0-835f-454a-8f60-83602eb93554
125492025-03-25T22:11:08.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ad33fa37-82b3-45bd-9033-cdf0b1870dc7 resource = Database result = Ok(()) uri = /vmms/bf47b3f0-835f-454a-8f60-83602eb93554
125502025-03-25T22:11:08.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ad33fa37-82b3-45bd-9033-cdf0b1870dc7 roles = RoleSet { roles: {} } uri = /vmms/bf47b3f0-835f-454a-8f60-83602eb93554
125512025-03-25T22:11:08.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ad33fa37-82b3-45bd-9033-cdf0b1870dc7 resource = Database result = Ok(()) uri = /vmms/bf47b3f0-835f-454a-8f60-83602eb93554
125522025-03-25T22:11:08.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ad33fa37-82b3-45bd-9033-cdf0b1870dc7 roles = RoleSet { roles: {} } uri = /vmms/bf47b3f0-835f-454a-8f60-83602eb93554
125532025-03-25T22:11:08.217ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ad33fa37-82b3-45bd-9033-cdf0b1870dc7 resource = Database result = Ok(()) uri = /vmms/bf47b3f0-835f-454a-8f60-83602eb93554
125542025-03-25T22:11:08.219ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ad33fa37-82b3-45bd-9033-cdf0b1870dc7 roles = RoleSet { roles: {} } uri = /vmms/bf47b3f0-835f-454a-8f60-83602eb93554
125552025-03-25T22:11:08.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ad33fa37-82b3-45bd-9033-cdf0b1870dc7 resource = Database result = Ok(()) uri = /vmms/bf47b3f0-835f-454a-8f60-83602eb93554
125562025-03-25T22:11:08.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ad33fa37-82b3-45bd-9033-cdf0b1870dc7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/bf47b3f0-835f-454a-8f60-83602eb93554
125572025-03-25T22:11:08.223ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ad33fa37-82b3-45bd-9033-cdf0b1870dc7 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, lookup_type: ById(5c35ff8c-21dd-48b9-9751-76bfa681bc38) }, key: 8d0ea42b-d77d-424d-a7af-1db382bd9f03, lookup_type: ById(8d0ea42b-d77d-424d-a7af-1db382bd9f03) }, key: a41f22f9-aa36-48e8-a4b9-411391eb187d, lookup_type: ById(a41f22f9-aa36-48e8-a4b9-411391eb187d) } result = Ok(()) uri = /vmms/bf47b3f0-835f-454a-8f60-83602eb93554
125582025-03-25T22:11:08.235ZINFOnexus (dropshot_internal): starting update saga for a41f22f9-aa36-48e8-a4b9-411391eb187d actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1551 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ad33fa37-82b3-45bd-9033-cdf0b1870dc7 uri = /vmms/bf47b3f0-835f-454a-8f60-83602eb93554 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-03-25T22:11:08.159385993Z }
125592025-03-25T22:11:08.238ZDEBGnexus (dropshot_internal): preparing instance-update saga for a41f22f9-aa36-48e8-a4b9-411391eb187d... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ad33fa37-82b3-45bd-9033-cdf0b1870dc7 uri = /vmms/bf47b3f0-835f-454a-8f60-83602eb93554
125602025-03-25T22:11:08.238ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 78409 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ad33fa37-82b3-45bd-9033-cdf0b1870dc7 response_code = 204 uri = /vmms/bf47b3f0-835f-454a-8f60-83602eb93554
125612025-03-25T22:11:08.238ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f saga_name = start-instance-update
125622025-03-25T22:11:08.238ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"a41f22f9-aa36-48e8-a4b9-411391eb187d","lookup_type":{"ById":"a41f22f9-aa36-48e8-a4b9-411391eb187d"},"parent":{"key":"8d0ea42b-d77d-424d-a7af-1db382bd9f03","lookup_type":{"ById":"8d0ea42b-d77d-424d-a7af-1db382bd9f03"},"parent":{"key":"5c35ff8c-21dd-48b9-9751-76bfa681bc38","lookup_type":{"ById":"5c35ff8c-21dd-48b9-9751-76bfa681bc38"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1146 saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f saga_name = start-instance-update sec_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
125632025-03-25T22:11:08.238ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f saga_name = start-instance-update
125642025-03-25T22:11:08.238ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2088 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = bf47b3f0-835f-454a-8f60-83602eb93554 remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0c356c8e-601f-4331-be85-b79395520518 uri = /vmms/bf47b3f0-835f-454a-8f60-83602eb93554 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-03-25T22:11:08.159385993Z }
125652025-03-25T22:11:08.238ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0c356c8e-601f-4331-be85-b79395520518 roles = RoleSet { roles: {} } uri = /vmms/bf47b3f0-835f-454a-8f60-83602eb93554
125662025-03-25T22:11:08.238ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0c356c8e-601f-4331-be85-b79395520518 resource = Database result = Ok(()) uri = /vmms/bf47b3f0-835f-454a-8f60-83602eb93554
125672025-03-25T22:11:08.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4401 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0c356c8e-601f-4331-be85-b79395520518 response_code = 204 uri = /vmms/bf47b3f0-835f-454a-8f60-83602eb93554
125682025-03-25T22:11:08.286ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f saga_name = start-instance-update
125692025-03-25T22:11:08.286ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:967 saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f saga_name = start-instance-update sec_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
125702025-03-25T22:11:08.286ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
125712025-03-25T22:11:08.286ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f
125722025-03-25T22:11:08.296ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
125732025-03-25T22:11:08.296ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f
125742025-03-25T22:11:08.302ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
125752025-03-25T22:11:08.302ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f
125762025-03-25T22:11:08.313ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
125772025-03-25T22:11:08.313ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("bd8c2eb1-2fdc-446c-a5cb-49259a31f5aa")) node_id = 0 saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f
125782025-03-25T22:11:08.319ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
125792025-03-25T22:11:08.319ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f
125802025-03-25T22:11:08.339ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f saga_name = start-instance-update
125812025-03-25T22:11:08.339ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f saga_name = start-instance-update saga_node = LockInstance
125822025-03-25T22:11:08.339ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f saga_name = start-instance-update saga_node = LockInstance
125832025-03-25T22:11:08.341ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f saga_name = start-instance-update saga_node = LockInstance
125842025-03-25T22:11:08.341ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f saga_name = start-instance-update saga_node = LockInstance
125852025-03-25T22:11:08.343ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f saga_name = start-instance-update saga_node = LockInstance
125862025-03-25T22:11:08.343ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f saga_name = start-instance-update saga_node = LockInstance
125872025-03-25T22:11:08.345ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f saga_name = start-instance-update saga_node = LockInstance
125882025-03-25T22:11:08.345ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f saga_name = start-instance-update saga_node = LockInstance
125892025-03-25T22:11:08.346ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f saga_name = start-instance-update saga_node = LockInstance
125902025-03-25T22:11:08.346ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f saga_name = start-instance-update saga_node = LockInstance
125912025-03-25T22:11:08.347ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f saga_name = start-instance-update saga_node = LockInstance
125922025-03-25T22:11:08.348ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f saga_name = start-instance-update saga_node = LockInstance
125932025-03-25T22:11:08.349ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f saga_name = start-instance-update saga_node = LockInstance
125942025-03-25T22:11:08.352ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, lookup_type: ById(5c35ff8c-21dd-48b9-9751-76bfa681bc38) }, key: 8d0ea42b-d77d-424d-a7af-1db382bd9f03, lookup_type: ById(8d0ea42b-d77d-424d-a7af-1db382bd9f03) }, key: a41f22f9-aa36-48e8-a4b9-411391eb187d, lookup_type: ById(a41f22f9-aa36-48e8-a4b9-411391eb187d) } result = Ok(()) saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f saga_name = start-instance-update saga_node = LockInstance
125952025-03-25T22:11:08.355ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f saga_name = start-instance-update saga_node = LockInstance updater_id = bd8c2eb1-2fdc-446c-a5cb-49259a31f5aa
125962025-03-25T22:11:08.355ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f saga_name = start-instance-update saga_node = LockInstance
125972025-03-25T22:11:08.355ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f saga_name = start-instance-update saga_node = LockInstance
125982025-03-25T22:11:08.367ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f saga_name = start-instance-update saga_node = LockInstance updater_id = bd8c2eb1-2fdc-446c-a5cb-49259a31f5aa
125992025-03-25T22:11:08.367ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f saga_name = start-instance-update saga_node = LockInstance
126002025-03-25T22:11:08.367ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f saga_name = start-instance-update saga_node = LockInstance
126012025-03-25T22:11:08.372ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d locked_gen = Generation(Generation(2)) saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f saga_name = start-instance-update saga_node = LockInstance updater_id = bd8c2eb1-2fdc-446c-a5cb-49259a31f5aa
126022025-03-25T22:11:08.374ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
126032025-03-25T22:11:08.374ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("bd8c2eb1-2fdc-446c-a5cb-49259a31f5aa")}) node_id = 1 saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f
126042025-03-25T22:11:08.381ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
126052025-03-25T22:11:08.381ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f
126062025-03-25T22:11:08.394ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
126072025-03-25T22:11:08.394ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
126082025-03-25T22:11:08.395ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
126092025-03-25T22:11:08.396ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
126102025-03-25T22:11:08.397ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
126112025-03-25T22:11:08.397ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
126122025-03-25T22:11:08.399ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
126132025-03-25T22:11:08.402ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, lookup_type: ById(5c35ff8c-21dd-48b9-9751-76bfa681bc38) }, key: 8d0ea42b-d77d-424d-a7af-1db382bd9f03, lookup_type: ById(8d0ea42b-d77d-424d-a7af-1db382bd9f03) }, key: a41f22f9-aa36-48e8-a4b9-411391eb187d, lookup_type: ById(a41f22f9-aa36-48e8-a4b9-411391eb187d) } result = Ok(()) saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
126142025-03-25T22:11:08.402ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
126152025-03-25T22:11:08.402ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
126162025-03-25T22:11:08.410ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: bf47b3f0-835f-454a-8f60-83602eb93554, time_created: 2025-03-25T22:10:47.499928Z, time_deleted: None, instance_id: a41f22f9-aa36-48e8-a4b9-411391eb187d, sled_id: f034aaf6-2037-4cb4-8409-3ab31c15cc28, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2025-03-25T22:11:08.159385Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2025-03-25T22:10:44.741940Z, gen: Generation(Generation(3)), propolis_id: Some(bf47b3f0-835f-454a-8f60-83602eb93554), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(bf47b3f0-835f-454a-8f60-83602eb93554 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2025-03-25T22:11:08.407894054Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
126172025-03-25T22:11:08.417ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update
126182025-03-25T22:11:08.417ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"a41f22f9-aa36-48e8-a4b9-411391eb187d","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"bf47b3f0-835f-454a-8f60-83602eb93554"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"a41f22f9-aa36-48e8-a4b9-411391eb187d","lookup_type":{"ById":"a41f22f9-aa36-48e8-a4b9-411391eb187d"},"parent":{"key":"8d0ea42b-d77d-424d-a7af-1db382bd9f03","lookup_type":{"ById":"8d0ea42b-d77d-424d-a7af-1db382bd9f03"},"parent":{"key":"5c35ff8c-21dd-48b9-9751-76bfa681bc38","lookup_type":{"ById":"5c35ff8c-21dd-48b9-9751-76bfa681bc38"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"bd8c2eb1-2fdc-446c-a5cb-49259a31f5aa"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"8d0ea42b-d77d-424d-a7af-1db382bd9f03","ram_diff":1073741824},"destroy_active_vmm":"bf47b3f0-835f-454a-8f60-83602eb93554","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2025-03-25T22:11:08.407894054Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1146 saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update sec_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
126192025-03-25T22:11:08.417ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update
126202025-03-25T22:11:08.450ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update
126212025-03-25T22:11:08.450ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:967 saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update sec_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
126222025-03-25T22:11:08.450ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
126232025-03-25T22:11:08.450ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9
126242025-03-25T22:11:08.454ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
126252025-03-25T22:11:08.454ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9
126262025-03-25T22:11:08.460ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
126272025-03-25T22:11:08.460ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9
126282025-03-25T22:11:08.467ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
126292025-03-25T22:11:08.467ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("a6530bad-0897-4b4a-99c1-67140a613ad2")) node_id = 0 saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9
126302025-03-25T22:11:08.474ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
126312025-03-25T22:11:08.474ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9
126322025-03-25T22:11:08.482ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d parent_lock = UpdaterLock { updater_id: bd8c2eb1-2fdc-446c-a5cb-49259a31f5aa, locked_gen: Generation(Generation(2)) } saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update
126332025-03-25T22:11:08.482ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update saga_node = BecomeUpdater
126342025-03-25T22:11:08.482ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update saga_node = BecomeUpdater
126352025-03-25T22:11:08.493ZDEBGnexus (SagaExecutor): inherited lock from bd8c2eb1-2fdc-446c-a5cb-49259a31f5aa to a6530bad-0897-4b4a-99c1-67140a613ad2 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = bd8c2eb1-2fdc-446c-a5cb-49259a31f5aa saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update saga_node = BecomeUpdater updater_id = a6530bad-0897-4b4a-99c1-67140a613ad2
126362025-03-25T22:11:08.493ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update
126372025-03-25T22:11:08.493ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
126382025-03-25T22:11:08.493ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("a6530bad-0897-4b4a-99c1-67140a613ad2")}) node_id = 1 saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9
126392025-03-25T22:11:08.498ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
126402025-03-25T22:11:08.498ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9
126412025-03-25T22:11:08.503ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
126422025-03-25T22:11:08.503ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9
126432025-03-25T22:11:08.512ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
126442025-03-25T22:11:08.512ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9
126452025-03-25T22:11:08.521ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update
126462025-03-25T22:11:08.521ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d
126472025-03-25T22:11:08.525ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update saga_node = UpdateNetworkConfig
126482025-03-25T22:11:08.525ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update saga_node = UpdateNetworkConfig
126492025-03-25T22:11:08.530ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update saga_node = UpdateNetworkConfig
126502025-03-25T22:11:08.530ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update saga_node = UpdateNetworkConfig
126512025-03-25T22:11:08.532ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
126522025-03-25T22:11:08.532ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update saga_node = UpdateNetworkConfig
126532025-03-25T22:11:08.532ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update saga_node = UpdateNetworkConfig
126542025-03-25T22:11:08.534ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
126552025-03-25T22:11:08.534ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
126562025-03-25T22:11:08.534ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
126572025-03-25T22:11:08.535ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
126582025-03-25T22:11:08.536ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
126592025-03-25T22:11:08.536ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
126602025-03-25T22:11:08.537ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
126612025-03-25T22:11:08.543ZDEBGnexus: notifying dendrite of updates instance_id = Some(a41f22f9-aa36-48e8-a4b9-411391eb187d (instance)) switch = switch0
126622025-03-25T22:11:08.544ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6821, tv_nsec: 879655560 } })
126632025-03-25T22:11:08.544ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1171
126642025-03-25T22:11:08.574ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
126652025-03-25T22:11:08.574ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
126662025-03-25T22:11:08.574ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8595dd24-b4b8-47ce-92f2-74fe4c512f56", "content-length": "26", "date": "Tue, 25 Mar 2025 22:11:08 GMT"} })
126672025-03-25T22:11:08.574ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
126682025-03-25T22:11:08.575ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 690 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = c05c2e02-630e-4de5-9c65-fd0f37c82666 response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
126692025-03-25T22:11:08.576ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
126702025-03-25T22:11:08.606ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
126712025-03-25T22:11:08.606ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "e897d28a-b851-4a5a-b827-1f31fdd2f6de", "content-length": "4", "date": "Tue, 25 Mar 2025 22:11:08 GMT"} })
126722025-03-25T22:11:08.608ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
126732025-03-25T22:11:08.608ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9
126742025-03-25T22:11:08.615ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
126752025-03-25T22:11:08.615ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9
126762025-03-25T22:11:08.628ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
126772025-03-25T22:11:08.628ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
126782025-03-25T22:11:08.650ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2025-03-25T22:11:08.630857Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, time_modified: Some(2025-03-25T22:11:08.630857Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 8d0ea42b-d77d-424d-a7af-1db382bd9f03, time_modified: Some(2025-03-25T22:11:08.630857Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update
126792025-03-25T22:11:08.650ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
126802025-03-25T22:11:08.650ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9
126812025-03-25T22:11:08.656ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
126822025-03-25T22:11:08.656ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9
126832025-03-25T22:11:08.662ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update
126842025-03-25T22:11:08.662ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update saga_node = UnassignOximeterProducer
126852025-03-25T22:11:08.663ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update saga_node = UnassignOximeterProducer
126862025-03-25T22:11:08.669ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = ec539d60-a406-4fe9-a658-fbc8b3fb545b producer_id = a41f22f9-aa36-48e8-a4b9-411391eb187d saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update
126872025-03-25T22:11:08.669ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update saga_node = UnassignOximeterProducer
126882025-03-25T22:11:08.669ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update saga_node = UnassignOximeterProducer
126892025-03-25T22:11:08.706ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = a41f22f9-aa36-48e8-a4b9-411391eb187d saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update
126902025-03-25T22:11:08.706ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = a41f22f9-aa36-48e8-a4b9-411391eb187d saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/a41f22f9-aa36-48e8-a4b9-411391eb187d
126912025-03-25T22:11:08.733ZDEBGnexus (SagaExecutor): client response oximeter-collector = a41f22f9-aa36-48e8-a4b9-411391eb187d result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/a41f22f9-aa36-48e8-a4b9-411391eb187d", status: 204, headers: {"x-request-id": "8a5da979-c3d9-472c-ae7a-934ca7c3964b", "date": "Tue, 25 Mar 2025 22:11:08 GMT"} }) saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update
126922025-03-25T22:11:08.733ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = ec539d60-a406-4fe9-a658-fbc8b3fb545b producer_id = a41f22f9-aa36-48e8-a4b9-411391eb187d saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update
126932025-03-25T22:11:08.736ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
126942025-03-25T22:11:08.736ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9
126952025-03-25T22:11:08.741ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
126962025-03-25T22:11:08.741ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9
126972025-03-25T22:11:08.747ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d lock = UpdaterLock { updater_id: a6530bad-0897-4b4a-99c1-67140a613ad2, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2025-03-25T22:11:08.407894054Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update
126982025-03-25T22:11:08.747ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update saga_node = CommitInstanceUpdates
126992025-03-25T22:11:08.747ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update saga_node = CommitInstanceUpdates
127002025-03-25T22:11:08.792ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d new_runtime = InstanceRuntimeState { time_updated: 2025-03-25T22:11:08.407894054Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update
127012025-03-25T22:11:08.792ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
127022025-03-25T22:11:08.792ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9
127032025-03-25T22:11:08.792ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Signaled
127042025-03-25T22:11:08.792ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Signaled
127052025-03-25T22:11:08.792ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
127062025-03-25T22:11:08.792ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
127072025-03-25T22:11:08.792ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127082025-03-25T22:11:08.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
127092025-03-25T22:11:08.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127102025-03-25T22:11:08.794ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127112025-03-25T22:11:08.796ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
127122025-03-25T22:11:08.796ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127132025-03-25T22:11:08.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127142025-03-25T22:11:08.797ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127152025-03-25T22:11:08.798ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
127162025-03-25T22:11:08.798ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9
127172025-03-25T22:11:08.799ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
127182025-03-25T22:11:08.799ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127192025-03-25T22:11:08.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127202025-03-25T22:11:08.803ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
127212025-03-25T22:11:08.803ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("a41f22f9-aa36-48e8-a4b9-411391eb187d"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("bf47b3f0-835f-454a-8f60-83602eb93554")}) node_id = 7 saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9
127222025-03-25T22:11:08.809ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
127232025-03-25T22:11:08.809ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9
127242025-03-25T22:11:08.815ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
127252025-03-25T22:11:08.815ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9
127262025-03-25T22:11:08.819ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
127272025-03-25T22:11:08.819ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9
127282025-03-25T22:11:08.826ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:82 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d propolis_id = bf47b3f0-835f-454a-8f60-83602eb93554 saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update
127292025-03-25T22:11:08.826ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update saga_node = ReleaseSledResources
127302025-03-25T22:11:08.826ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update saga_node = ReleaseSledResources
127312025-03-25T22:11:08.831ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
127322025-03-25T22:11:08.831ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
127332025-03-25T22:11:08.832ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5697d2c7-89ad-4433-9b3d-b0427802d8e5", "content-length": "372", "date": "Tue, 25 Mar 2025 22:11:08 GMT"} })
127342025-03-25T22:11:08.832ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127352025-03-25T22:11:08.832ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
127362025-03-25T22:11:08.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127372025-03-25T22:11:08.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
127382025-03-25T22:11:08.846ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
127392025-03-25T22:11:08.846ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9
127402025-03-25T22:11:08.850ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
127412025-03-25T22:11:08.850ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9
127422025-03-25T22:11:08.857ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:113 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d propolis_id = bf47b3f0-835f-454a-8f60-83602eb93554 saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update
127432025-03-25T22:11:08.857ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update saga_node = MarkVmmDeleted
127442025-03-25T22:11:08.857ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update saga_node = MarkVmmDeleted
127452025-03-25T22:11:08.876ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {51c96537-3876-409e-8967-6e6cd1c05921: {10.151.2.176: {7797b4f0-9b76-4135-b55c-23637b7be801}, 10.151.2.175: {7797b4f0-9b76-4135-b55c-23637b7be801}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
127462025-03-25T22:11:08.876ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
127472025-03-25T22:11:08.877ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "0c395db6-6aee-459c-9fe8-7f263adf6a50", "date": "Tue, 25 Mar 2025 22:11:08 GMT"} })
127482025-03-25T22:11:08.877ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127492025-03-25T22:11:08.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127502025-03-25T22:11:08.880ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127512025-03-25T22:11:08.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127522025-03-25T22:11:08.883ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127532025-03-25T22:11:08.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127542025-03-25T22:11:08.886ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
127552025-03-25T22:11:08.886ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
127562025-03-25T22:11:08.887ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "091fe599-36a6-4fa4-aa8e-bc526263fc86", "date": "Tue, 25 Mar 2025 22:11:08 GMT"} })
127572025-03-25T22:11:08.888ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 96.462275ms iteration = 23 status = {}
127582025-03-25T22:11:08.902ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
127592025-03-25T22:11:08.902ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9
127602025-03-25T22:11:08.906ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
127612025-03-25T22:11:08.906ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9
127622025-03-25T22:11:08.911ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
127632025-03-25T22:11:08.911ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9
127642025-03-25T22:11:08.915ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
127652025-03-25T22:11:08.915ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9
127662025-03-25T22:11:08.923ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
127672025-03-25T22:11:08.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
127682025-03-25T22:11:08.924ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update saga_node = ChainSuccessorSaga
127692025-03-25T22:11:08.924ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update saga_node = ChainSuccessorSaga
127702025-03-25T22:11:08.925ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127712025-03-25T22:11:08.926ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update saga_node = ChainSuccessorSaga
127722025-03-25T22:11:08.926ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update saga_node = ChainSuccessorSaga
127732025-03-25T22:11:08.926ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
127742025-03-25T22:11:08.926ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
127752025-03-25T22:11:08.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
127762025-03-25T22:11:08.927ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update saga_node = ChainSuccessorSaga
127772025-03-25T22:11:08.927ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update saga_node = ChainSuccessorSaga
127782025-03-25T22:11:08.928ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127792025-03-25T22:11:08.929ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update saga_node = ChainSuccessorSaga
127802025-03-25T22:11:08.930ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
127812025-03-25T22:11:08.930ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
127822025-03-25T22:11:08.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
127832025-03-25T22:11:08.932ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, lookup_type: ById(5c35ff8c-21dd-48b9-9751-76bfa681bc38) }, key: 8d0ea42b-d77d-424d-a7af-1db382bd9f03, lookup_type: ById(8d0ea42b-d77d-424d-a7af-1db382bd9f03) }, key: a41f22f9-aa36-48e8-a4b9-411391eb187d, lookup_type: ById(a41f22f9-aa36-48e8-a4b9-411391eb187d) } result = Ok(()) saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update saga_node = ChainSuccessorSaga
127842025-03-25T22:11:08.932ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update saga_node = ChainSuccessorSaga
127852025-03-25T22:11:08.932ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update saga_node = ChainSuccessorSaga
127862025-03-25T22:11:08.937ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d karmic_state = WillReincarnate needs_reincarnation = false saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update
127872025-03-25T22:11:08.937ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
127882025-03-25T22:11:08.937ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9
127892025-03-25T22:11:08.942ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
127902025-03-25T22:11:08.942ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9
127912025-03-25T22:11:08.948ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
127922025-03-25T22:11:08.948ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9
127932025-03-25T22:11:08.953ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 sec_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
127942025-03-25T22:11:08.953ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9
127952025-03-25T22:11:09.006ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update sec_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
127962025-03-25T22:11:09.006ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 saga_name = instance-update saga_result = SagaResult { saga_id: ee76a736-e452-4f2e-bdf5-7c5598f75be9, saga_log: SagaLog { saga_id: ee76a736-e452-4f2e-bdf5-7c5598f75be9, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("a6530bad-0897-4b4a-99c1-67140a613ad2")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("a6530bad-0897-4b4a-99c1-67140a613ad2")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("a41f22f9-aa36-48e8-a4b9-411391eb187d"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("bf47b3f0-835f-454a-8f60-83602eb93554")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("a41f22f9-aa36-48e8-a4b9-411391eb187d"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("bf47b3f0-835f-454a-8f60-83602eb93554")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("a6530bad-0897-4b4a-99c1-67140a613ad2"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("a6530bad-0897-4b4a-99c1-67140a613ad2")}} }) }
127972025-03-25T22:11:09.006ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = ee76a736-e452-4f2e-bdf5-7c5598f75be9 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f saga_name = start-instance-update
127982025-03-25T22:11:09.006ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
127992025-03-25T22:11:09.006ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f
128002025-03-25T22:11:09.012ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
128012025-03-25T22:11:09.012ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f
128022025-03-25T22:11:09.017ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
128032025-03-25T22:11:09.017ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f
128042025-03-25T22:11:09.019ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
128052025-03-25T22:11:09.019ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5def7f19-c172-456f-a78c-721e36b7c97f", "content-length": "691", "date": "Tue, 25 Mar 2025 22:11:08 GMT"} })
128062025-03-25T22:11:09.019ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
128072025-03-25T22:11:09.019ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
128082025-03-25T22:11:09.019ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
128092025-03-25T22:11:09.020ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 228.244517ms iteration = 23 status = {}
128102025-03-25T22:11:09.022ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f sec_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
128112025-03-25T22:11:09.022ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f
128122025-03-25T22:11:09.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c3b5c026-11ff-47be-80b5-ccd59e0dfda8 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
128132025-03-25T22:11:09.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c3b5c026-11ff-47be-80b5-ccd59e0dfda8 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
128142025-03-25T22:11:09.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2186 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c3b5c026-11ff-47be-80b5-ccd59e0dfda8 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
128152025-03-25T22:11:09.065ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f saga_name = start-instance-update sec_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
128162025-03-25T22:11:09.065ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = be85afa0-9d23-45b4-9bf0-622a48ce725f saga_name = start-instance-update saga_result = SagaResult { saga_id: be85afa0-9d23-45b4-9bf0-622a48ce725f, saga_log: SagaLog { saga_id: be85afa0-9d23-45b4-9bf0-622a48ce725f, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("bd8c2eb1-2fdc-446c-a5cb-49259a31f5aa")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("bd8c2eb1-2fdc-446c-a5cb-49259a31f5aa")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("bd8c2eb1-2fdc-446c-a5cb-49259a31f5aa"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("bd8c2eb1-2fdc-446c-a5cb-49259a31f5aa")}} }) }
128172025-03-25T22:11:10.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e6d4479f-1c79-45b4-b5c6-20b7826c1f79 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
128182025-03-25T22:11:10.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e6d4479f-1c79-45b4-b5c6-20b7826c1f79 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
128192025-03-25T22:11:10.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1956 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e6d4479f-1c79-45b4-b5c6-20b7826c1f79 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
128202025-03-25T22:11:10.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
128212025-03-25T22:11:10.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
128222025-03-25T22:11:10.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
128232025-03-25T22:11:10.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
128242025-03-25T22:11:10.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
128252025-03-25T22:11:10.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
128262025-03-25T22:11:10.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128272025-03-25T22:11:10.846ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
128282025-03-25T22:11:10.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
128292025-03-25T22:11:10.848ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.40024ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
128302025-03-25T22:11:10.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
128312025-03-25T22:11:10.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
128322025-03-25T22:11:10.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
128332025-03-25T22:11:10.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
128342025-03-25T22:11:10.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
128352025-03-25T22:11:10.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128362025-03-25T22:11:10.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
128372025-03-25T22:11:10.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
128382025-03-25T22:11:10.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
128392025-03-25T22:11:10.861ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
128402025-03-25T22:11:10.861ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.398264ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
128412025-03-25T22:11:11.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 098c0f2e-8d32-4078-8aa7-9d3384029365 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
128422025-03-25T22:11:11.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 098c0f2e-8d32-4078-8aa7-9d3384029365 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
128432025-03-25T22:11:11.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1746 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 098c0f2e-8d32-4078-8aa7-9d3384029365 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
128442025-03-25T22:11:12.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7edaf2be-79a3-4a68-9cc3-8cbf6f84eefe roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
128452025-03-25T22:11:12.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7edaf2be-79a3-4a68-9cc3-8cbf6f84eefe resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
128462025-03-25T22:11:12.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2251 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7edaf2be-79a3-4a68-9cc3-8cbf6f84eefe response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
128472025-03-25T22:11:13.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a5548d81-b3bd-459b-9ded-2284b115a850 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
128482025-03-25T22:11:13.132ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a5548d81-b3bd-459b-9ded-2284b115a850 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
128492025-03-25T22:11:13.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2291 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a5548d81-b3bd-459b-9ded-2284b115a850 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
128502025-03-25T22:11:14.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 45a10ab5-2cc3-441e-8b48-f22a8f63ab84 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
128512025-03-25T22:11:14.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 45a10ab5-2cc3-441e-8b48-f22a8f63ab84 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
128522025-03-25T22:11:14.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2498 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 45a10ab5-2cc3-441e-8b48-f22a8f63ab84 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
128532025-03-25T22:11:15.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7681cbdf-b8ce-4bc0-8c79-394fb224ec49 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
128542025-03-25T22:11:15.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7681cbdf-b8ce-4bc0-8c79-394fb224ec49 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
128552025-03-25T22:11:15.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2534 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7681cbdf-b8ce-4bc0-8c79-394fb224ec49 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
128562025-03-25T22:11:16.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 58766c45-a316-4c5d-9993-cda709878e14 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
128572025-03-25T22:11:16.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 58766c45-a316-4c5d-9993-cda709878e14 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
128582025-03-25T22:11:16.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2331 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 58766c45-a316-4c5d-9993-cda709878e14 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
128592025-03-25T22:11:17.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 222f1cc4-4ea7-4753-be9e-1fc585005819 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
128602025-03-25T22:11:17.220ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 222f1cc4-4ea7-4753-be9e-1fc585005819 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
128612025-03-25T22:11:17.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2684 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 222f1cc4-4ea7-4753-be9e-1fc585005819 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
128622025-03-25T22:11:18.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 792b8389-2308-48f5-ab6f-496314106ece roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
128632025-03-25T22:11:18.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 792b8389-2308-48f5-ab6f-496314106ece resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
128642025-03-25T22:11:18.244ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2202 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 792b8389-2308-48f5-ab6f-496314106ece response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
128652025-03-25T22:11:18.573ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 581 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = 5b71b69d-b674-425d-a681-8a2b30f49fd9 response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
128662025-03-25T22:11:19.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7099742f-2dc1-4973-babf-b0d3fa8fe6de roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
128672025-03-25T22:11:19.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7099742f-2dc1-4973-babf-b0d3fa8fe6de resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
128682025-03-25T22:11:19.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2471 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7099742f-2dc1-4973-babf-b0d3fa8fe6de response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
128692025-03-25T22:11:20.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c211845f-8707-4595-a2e6-5c233a9115c7 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
128702025-03-25T22:11:20.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c211845f-8707-4595-a2e6-5c233a9115c7 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
128712025-03-25T22:11:20.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2685 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c211845f-8707-4595-a2e6-5c233a9115c7 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
128722025-03-25T22:11:20.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
128732025-03-25T22:11:20.843ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
128742025-03-25T22:11:20.843ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
128752025-03-25T22:11:20.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
128762025-03-25T22:11:20.843ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
128772025-03-25T22:11:20.843ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
128782025-03-25T22:11:20.843ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
128792025-03-25T22:11:20.843ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
128802025-03-25T22:11:20.843ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
128812025-03-25T22:11:20.843ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
128822025-03-25T22:11:20.843ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
128832025-03-25T22:11:20.843ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
128842025-03-25T22:11:20.843ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
128852025-03-25T22:11:20.843ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
128862025-03-25T22:11:20.843ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
128872025-03-25T22:11:20.843ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
128882025-03-25T22:11:20.843ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
128892025-03-25T22:11:20.843ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 23 reason = Timeout
128902025-03-25T22:11:20.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
128912025-03-25T22:11:20.843ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:82 reason = blueprint disabled target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7
128922025-03-25T22:11:20.843ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
128932025-03-25T22:11:20.843ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.08\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7"}
128942025-03-25T22:11:20.843ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
128952025-03-25T22:11:20.843ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
128962025-03-25T22:11:20.843ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
128972025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
128982025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
128992025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
129002025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
129012025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
129022025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
129032025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
129042025-03-25T22:11:20.844ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
129052025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
129062025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
129072025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
129082025-03-25T22:11:20.844ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-03-25 22:01:20.843906176 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
129092025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
129102025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
129112025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
129122025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
129132025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
129142025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
129152025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
129162025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
129172025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
129182025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
129192025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
129202025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
129212025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
129222025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
129232025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
129242025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
129252025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
129262025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
129272025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
129282025-03-25T22:11:20.844ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5533f428-2028-4269-b7b1-f15912c01133.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("66b022b6-2e12-413e-b4b7-56c4ad5bdd77.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f337d25b-c67a-4a32-89e1-e187aea97ed9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f337d25b-c67a-4a32-89e1-e187aea97ed9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 6834, tv_nsec: 180127895 } })
129292025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
129302025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
129312025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
129322025-03-25T22:11:20.844ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
129332025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
129342025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
129352025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
129362025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
129372025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
129382025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
129392025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
129402025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
129412025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
129422025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
129432025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
129442025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
129452025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
129462025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
129472025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
129482025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
129492025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 23 reason = Timeout
129502025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
129512025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
129522025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
129532025-03-25T22:11:20.844ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("58d382a7-99da-40a7-bc9f-2da7e9b156c1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d42076c6-06fe-4102-a978-c7d0a8dffb98.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d42076c6-06fe-4102-a978-c7d0a8dffb98.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 6834, tv_nsec: 180339698 } })
129542025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
129552025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
129562025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
129572025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
129582025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
129592025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
129602025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
129612025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
129622025-03-25T22:11:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
129632025-03-25T22:11:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
129642025-03-25T22:11:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
129652025-03-25T22:11:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
129662025-03-25T22:11:20.845ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
129672025-03-25T22:11:20.845ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.204361ms iteration = 12 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
129682025-03-25T22:11:20.845ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
129692025-03-25T22:11:20.845ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.441645ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
129702025-03-25T22:11:20.846ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129712025-03-25T22:11:20.847ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
129722025-03-25T22:11:20.847ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129732025-03-25T22:11:20.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
129742025-03-25T22:11:20.847ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6834, tv_nsec: 183249959 } })
129752025-03-25T22:11:20.847ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1171
129762025-03-25T22:11:20.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
129772025-03-25T22:11:20.848ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
129782025-03-25T22:11:20.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
129792025-03-25T22:11:20.848ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.264162ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
129802025-03-25T22:11:20.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
129812025-03-25T22:11:20.849ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
129822025-03-25T22:11:20.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
129832025-03-25T22:11:20.850ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129842025-03-25T22:11:20.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129852025-03-25T22:11:20.851ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
129862025-03-25T22:11:20.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
129872025-03-25T22:11:20.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
129882025-03-25T22:11:20.854ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
129892025-03-25T22:11:20.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
129902025-03-25T22:11:20.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
129912025-03-25T22:11:20.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
129922025-03-25T22:11:20.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
129932025-03-25T22:11:20.855ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129942025-03-25T22:11:20.856ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6834, tv_nsec: 192245066 } })
129952025-03-25T22:11:20.856ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129962025-03-25T22:11:20.856ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1171
129972025-03-25T22:11:20.857ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
129982025-03-25T22:11:20.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
129992025-03-25T22:11:20.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
130002025-03-25T22:11:20.857ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
130012025-03-25T22:11:20.857ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-03-25 22:01:20.843906176 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
130022025-03-25T22:11:20.857ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 13.901083ms iteration = 12 status = {"expiration":"2025-03-25T22:01:20.843906176Z","pruned":[]}
130032025-03-25T22:11:20.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
130042025-03-25T22:11:20.859ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
130052025-03-25T22:11:20.859ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
130062025-03-25T22:11:20.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
130072025-03-25T22:11:20.863ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 19.334627ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
130082025-03-25T22:11:20.868ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
130092025-03-25T22:11:20.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
130102025-03-25T22:11:20.869ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
130112025-03-25T22:11:20.869ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6834, tv_nsec: 205228263 } })
130122025-03-25T22:11:20.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
130132025-03-25T22:11:20.869ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1171 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
130142025-03-25T22:11:20.871ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
130152025-03-25T22:11:20.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
130162025-03-25T22:11:20.913ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130172025-03-25T22:11:20.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
130182025-03-25T22:11:20.916ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
130192025-03-25T22:11:20.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
130202025-03-25T22:11:20.917ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
130212025-03-25T22:11:20.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
130222025-03-25T22:11:20.921ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
130232025-03-25T22:11:20.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
130242025-03-25T22:11:20.924ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130252025-03-25T22:11:20.925ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
130262025-03-25T22:11:20.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
130272025-03-25T22:11:20.928ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
130282025-03-25T22:11:20.928ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
130292025-03-25T22:11:20.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
130302025-03-25T22:11:20.928ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
130312025-03-25T22:11:20.928ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
130322025-03-25T22:11:20.928ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
130332025-03-25T22:11:20.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
130342025-03-25T22:11:20.929ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
130352025-03-25T22:11:20.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
130362025-03-25T22:11:20.930ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 85.591326ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
130372025-03-25T22:11:20.931ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 86.699185ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
130382025-03-25T22:11:20.931ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130392025-03-25T22:11:20.932ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130402025-03-25T22:11:20.934ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130412025-03-25T22:11:20.935ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130422025-03-25T22:11:20.936ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 91.640351ms iteration = 23 status = {"errors":[],"requests_created_ok":[]}
130432025-03-25T22:11:20.936ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
130442025-03-25T22:11:20.936ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
130452025-03-25T22:11:20.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
130462025-03-25T22:11:20.936ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
130472025-03-25T22:11:20.936ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130482025-03-25T22:11:20.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130492025-03-25T22:11:20.937ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130502025-03-25T22:11:20.937ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 92.806451ms iteration = 23 status = {"errors":[],"finish_invoked_ok":[]}
130512025-03-25T22:11:20.939ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
130522025-03-25T22:11:20.939ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
130532025-03-25T22:11:20.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
130542025-03-25T22:11:20.939ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
130552025-03-25T22:11:20.939ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
130562025-03-25T22:11:20.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
130572025-03-25T22:11:20.942ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
130582025-03-25T22:11:20.942ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
130592025-03-25T22:11:20.942ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
130602025-03-25T22:11:20.942ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 98.411009ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
130612025-03-25T22:11:20.945ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
130622025-03-25T22:11:20.945ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
130632025-03-25T22:11:20.945ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
130642025-03-25T22:11:20.945ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130652025-03-25T22:11:20.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
130662025-03-25T22:11:20.948ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
130672025-03-25T22:11:20.948ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130682025-03-25T22:11:20.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130692025-03-25T22:11:20.955ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
130702025-03-25T22:11:20.955ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 111.08961ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
130712025-03-25T22:11:20.961ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
130722025-03-25T22:11:20.961ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 117.745457ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
130732025-03-25T22:11:20.967ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
130742025-03-25T22:11:20.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
130752025-03-25T22:11:20.971ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
130762025-03-25T22:11:20.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
130772025-03-25T22:11:20.989ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
130782025-03-25T22:11:20.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
130792025-03-25T22:11:20.991ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
130802025-03-25T22:11:20.991ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
130812025-03-25T22:11:20.991ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 147.149181ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
130822025-03-25T22:11:20.992ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 148.980633ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
130832025-03-25T22:11:20.997ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
130842025-03-25T22:11:20.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
130852025-03-25T22:11:20.999ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
130862025-03-25T22:11:20.999ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
130872025-03-25T22:11:20.999ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 154.949077ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
130882025-03-25T22:11:21.002ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
130892025-03-25T22:11:21.003ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130902025-03-25T22:11:21.004ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
130912025-03-25T22:11:21.004ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
130922025-03-25T22:11:21.004ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
130932025-03-25T22:11:21.004ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
130942025-03-25T22:11:21.004ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
130952025-03-25T22:11:21.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
130962025-03-25T22:11:21.004ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
130972025-03-25T22:11:21.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
130982025-03-25T22:11:21.005ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 160.707717ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
130992025-03-25T22:11:21.006ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
131002025-03-25T22:11:21.006ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
131012025-03-25T22:11:21.006ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
131022025-03-25T22:11:21.006ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
131032025-03-25T22:11:21.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
131042025-03-25T22:11:21.007ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
131052025-03-25T22:11:21.007ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
131062025-03-25T22:11:21.007ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
131072025-03-25T22:11:21.007ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
131082025-03-25T22:11:21.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
131092025-03-25T22:11:21.007ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "672de8e8-4672-4f4c-af75-c56ceca95f69", "content-length": "26", "date": "Tue, 25 Mar 2025 22:11:21 GMT"} })
131102025-03-25T22:11:21.007ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
131112025-03-25T22:11:21.010ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
131122025-03-25T22:11:21.013ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 168.680287ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
131132025-03-25T22:11:21.013ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131142025-03-25T22:11:21.017ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
131152025-03-25T22:11:21.017ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
131162025-03-25T22:11:21.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
131172025-03-25T22:11:21.019ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
131182025-03-25T22:11:21.019ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
131192025-03-25T22:11:21.019ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c2b29eaa-3dfc-4fd1-a697-80f810cba254", "content-length": "26", "date": "Tue, 25 Mar 2025 22:11:21 GMT"} })
131202025-03-25T22:11:21.019ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
131212025-03-25T22:11:21.021ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
131222025-03-25T22:11:21.022ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 zone_address = fd00:1122:3344:101::2
131232025-03-25T22:11:21.022ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
131242025-03-25T22:11:21.023ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b05793fb-d88b-4fe5-9865-0d1bb456163c", "content-length": "26", "date": "Tue, 25 Mar 2025 22:11:21 GMT"} })
131252025-03-25T22:11:21.023ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1184 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
131262025-03-25T22:11:21.025ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
131272025-03-25T22:11:21.034ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131282025-03-25T22:11:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f034aaf6-2037-4cb4-8409-3ab31c15cc28, lookup_type: ById(f034aaf6-2037-4cb4-8409-3ab31c15cc28) } result = Ok(())
131292025-03-25T22:11:21.037ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
131302025-03-25T22:11:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
131312025-03-25T22:11:21.044ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 200.834659ms iteration = 23 status = 0
131322025-03-25T22:11:21.052ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131332025-03-25T22:11:21.056ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
131342025-03-25T22:11:21.056ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
131352025-03-25T22:11:21.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
131362025-03-25T22:11:21.060ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
131372025-03-25T22:11:21.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
131382025-03-25T22:11:21.063ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131392025-03-25T22:11:21.064ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
131402025-03-25T22:11:21.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
131412025-03-25T22:11:21.068ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131422025-03-25T22:11:21.068ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
131432025-03-25T22:11:21.068ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
131442025-03-25T22:11:21.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
131452025-03-25T22:11:21.072ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
131462025-03-25T22:11:21.072ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
131472025-03-25T22:11:21.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
131482025-03-25T22:11:21.072ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
131492025-03-25T22:11:21.072ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 23d93905-7b89-4296-b050-7ff9ae235c15 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
131502025-03-25T22:11:21.072ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
131512025-03-25T22:11:21.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
131522025-03-25T22:11:21.076ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131532025-03-25T22:11:21.080ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
131542025-03-25T22:11:21.080ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
131552025-03-25T22:11:21.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
131562025-03-25T22:11:21.085ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131572025-03-25T22:11:21.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
131582025-03-25T22:11:21.090ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
131592025-03-25T22:11:21.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
131602025-03-25T22:11:21.109ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
131612025-03-25T22:11:21.109ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 265.131202ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
131622025-03-25T22:11:21.111ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 23d93905-7b89-4296-b050-7ff9ae235c15 dns_zone_name = control-plane.oxide.internal found_so_far = 52 version = 1
131632025-03-25T22:11:21.111ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
131642025-03-25T22:11:21.111ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-03-25 22:00:21.368103 UTC dns_group = internal generation = 1
131652025-03-25T22:11:21.111ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 267.503973ms iteration = 12 status = {"generation":1}
131662025-03-25T22:11:21.139ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:360
131672025-03-25T22:11:21.139ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 295.474042ms iteration = 23 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
131682025-03-25T22:11:21.146ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131692025-03-25T22:11:21.150ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
131702025-03-25T22:11:21.150ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
131712025-03-25T22:11:21.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
131722025-03-25T22:11:21.157ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 314.002205ms iteration = 26 status = {"physical_disks_added":0}
131732025-03-25T22:11:21.158ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
131742025-03-25T22:11:21.158ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 96679ce4-e18c-487b-803a-7b26be55e85c dns_zone_name = oxide.test found_so_far = 0 version = 2
131752025-03-25T22:11:21.158ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
131762025-03-25T22:11:21.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
131772025-03-25T22:11:21.261ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 417.836949ms iteration = 23 status = {}
131782025-03-25T22:11:21.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 119d32d5-403b-44a3-8717-73395b0f0a5c roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
131792025-03-25T22:11:21.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 119d32d5-403b-44a3-8717-73395b0f0a5c resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
131802025-03-25T22:11:21.317ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
131812025-03-25T22:11:21.317ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "65048dcb-ec78-4db0-aa8b-4e8fcf7db300", "date": "Tue, 25 Mar 2025 22:11:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
131822025-03-25T22:11:21.317ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
131832025-03-25T22:11:21.319ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "233872b7-be74-4c63-8189-64374a582bee", "date": "Tue, 25 Mar 2025 22:11:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
131842025-03-25T22:11:21.319ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
131852025-03-25T22:11:21.319ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
131862025-03-25T22:11:21.320ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4200aece-b829-4504-9aee-48214a18c45a", "content-length": "2", "date": "Tue, 25 Mar 2025 22:11:20 GMT"} })
131872025-03-25T22:11:21.321ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
131882025-03-25T22:11:21.321ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 477.569592ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
131892025-03-25T22:11:21.321ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
131902025-03-25T22:11:21.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
131912025-03-25T22:11:21.333ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
131922025-03-25T22:11:21.333ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
131932025-03-25T22:11:21.333ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
131942025-03-25T22:11:21.333ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f992c88-6600-482b-8633-ae66cc799b73", "content-length": "372", "date": "Tue, 25 Mar 2025 22:11:21 GMT"} })
131952025-03-25T22:11:21.333ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
131962025-03-25T22:11:21.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
131972025-03-25T22:11:21.335ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131982025-03-25T22:11:21.338ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
131992025-03-25T22:11:21.338ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
132002025-03-25T22:11:21.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
132012025-03-25T22:11:21.354ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
132022025-03-25T22:11:21.354ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0fc2d78e-3eb7-4bcb-88c6-4d79b92c6040", "content-length": "691", "date": "Tue, 25 Mar 2025 22:11:21 GMT"} })
132032025-03-25T22:11:21.354ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
132042025-03-25T22:11:21.354ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
132052025-03-25T22:11:21.354ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
132062025-03-25T22:11:21.356ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 52107 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 119d32d5-403b-44a3-8717-73395b0f0a5c response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
132072025-03-25T22:11:21.356ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 512.91677ms iteration = 23 status = null
132082025-03-25T22:11:21.357ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 513.424199ms iteration = 24 status = {}
132092025-03-25T22:11:21.357ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 96679ce4-e18c-487b-803a-7b26be55e85c dns_zone_name = oxide.test found_so_far = 1 version = 2
132102025-03-25T22:11:21.358ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
132112025-03-25T22:11:21.358ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-03-25 22:00:22.561696 UTC dns_group = external generation = 2
132122025-03-25T22:11:21.358ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 514.172191ms iteration = 12 status = {"generation":2}
132132025-03-25T22:11:21.376ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-03-25T22:00:16.382271Z, time_modified: 2025-03-25T22:00:16.382271Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, db_silo: Silo { identity: SiloIdentity { id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-25T22:00:22.501108Z, time_modified: 2025-03-25T22:00:22.501108Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, db_silo: Silo { identity: SiloIdentity { id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-25T22:00:22.501108Z, time_modified: 2025-03-25T22:00:22.501108Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
132142025-03-25T22:11:21.376ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 532.739676ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"5c35ff8c-21dd-48b9-9751-76bfa681bc38","tls_certs":["0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d"]}},"default_endpoint":{"silo_id":"5c35ff8c-21dd-48b9-9751-76bfa681bc38","tls_certs":["0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
132152025-03-25T22:11:21.390ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
132162025-03-25T22:11:21.390ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "77d4d8a2-48e8-4948-8053-0ea074618ad8", "date": "Tue, 25 Mar 2025 22:11:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
132172025-03-25T22:11:21.390ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
132182025-03-25T22:11:21.392ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "402443c9-1f9d-4fa3-a6e5-31399f7f8a69", "date": "Tue, 25 Mar 2025 22:11:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
132192025-03-25T22:11:21.392ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
132202025-03-25T22:11:21.394ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "714b5e24-b8a6-4d7c-b2af-40a8c5a695cc", "date": "Tue, 25 Mar 2025 22:11:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
132212025-03-25T22:11:21.394ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
132222025-03-25T22:11:21.396ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
132232025-03-25T22:11:21.396ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 553.084001ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
132242025-03-25T22:11:21.406ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
132252025-03-25T22:11:21.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
132262025-03-25T22:11:21.408ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a5db250-fa3f-4168-ab16-5c36568c22e2, rack_id: c7210e4b-5a81-4ec8-b8fe-816a9508dc74, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(6d5dda50-e3c4-4853-9bfa-a66b447ab351) } rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
132272025-03-25T22:11:21.408ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
132282025-03-25T22:11:21.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
132292025-03-25T22:11:21.414ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
132302025-03-25T22:11:21.414ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
132312025-03-25T22:11:21.414ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6f9feb06-4496-46c3-9e90-5376e20729b1", "date": "Tue, 25 Mar 2025 22:11:21 GMT"} })
132322025-03-25T22:11:21.414ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
132332025-03-25T22:11:21.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
132342025-03-25T22:11:21.416ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
132352025-03-25T22:11:21.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
132362025-03-25T22:11:21.419ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
132372025-03-25T22:11:21.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
132382025-03-25T22:11:21.420ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
132392025-03-25T22:11:21.420ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "65adedb8-e504-46c5-ba3f-f40dc9783e11", "content-length": "134", "date": "Tue, 25 Mar 2025 22:11:20 GMT"} })
132402025-03-25T22:11:21.420ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
132412025-03-25T22:11:21.420ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 6d5dda50-e3c4-4853-9bfa-a66b447ab351
132422025-03-25T22:11:21.420ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
132432025-03-25T22:11:21.420ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
132442025-03-25T22:11:21.420ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
132452025-03-25T22:11:21.420ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
132462025-03-25T22:11:21.420ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
132472025-03-25T22:11:21.420ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
132482025-03-25T22:11:21.421ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
132492025-03-25T22:11:21.421ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
132502025-03-25T22:11:21.421ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
132512025-03-25T22:11:21.421ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
132522025-03-25T22:11:21.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
132532025-03-25T22:11:21.422ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
132542025-03-25T22:11:21.422ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
132552025-03-25T22:11:21.422ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "084a7cd9-ce79-4288-9130-7693ec8fa06b", "date": "Tue, 25 Mar 2025 22:11:21 GMT"} })
132562025-03-25T22:11:21.424ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 579.791058ms iteration = 24 status = {}
132572025-03-25T22:11:21.424ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
132582025-03-25T22:11:21.425ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "84a5a61b-424c-4bae-bdf5-a090d5a78de2", "content-length": "2", "date": "Tue, 25 Mar 2025 22:11:20 GMT"} })
132592025-03-25T22:11:21.425ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
132602025-03-25T22:11:21.425ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c86c5ba-b9a8-49b1-b5fb-1e17f4f232dc", "content-length": "52", "date": "Tue, 25 Mar 2025 22:11:20 GMT"} })
132612025-03-25T22:11:21.425ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
132622025-03-25T22:11:21.425ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
132632025-03-25T22:11:21.525ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "0631181c-5a6e-437f-808f-9cdb238e6b36", "date": "Tue, 25 Mar 2025 22:11:21 GMT"} })
132642025-03-25T22:11:21.525ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch = Switch0
132652025-03-25T22:11:21.525ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
132662025-03-25T22:11:21.525ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "edcd9bdf-6b68-4fcc-a4ca-69b6eb6c8298", "content-length": "682", "date": "Tue, 25 Mar 2025 22:11:21 GMT"} })
132672025-03-25T22:11:21.525ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
132682025-03-25T22:11:21.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
132692025-03-25T22:11:21.529ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
132702025-03-25T22:11:21.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
132712025-03-25T22:11:21.532ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
132722025-03-25T22:11:21.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
132732025-03-25T22:11:21.535ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
132742025-03-25T22:11:21.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
132752025-03-25T22:11:21.542ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 699.083411ms iteration = 23 status = {}
132762025-03-25T22:11:21.702ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
132772025-03-25T22:11:21.702ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
132782025-03-25T22:11:21.733ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
132792025-03-25T22:11:21.734ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:32825
132802025-03-25T22:11:21.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:32825 req_id = b1cd31ce-f7b0-44c8-89f0-7823f480209b roles = RoleSet { roles: {} } uri = /metrics/producers
132812025-03-25T22:11:21.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:32825 req_id = b1cd31ce-f7b0-44c8-89f0-7823f480209b resource = Database result = Ok(()) uri = /metrics/producers
132822025-03-25T22:11:21.771ZINFOnexus: assigned collector to new producer collector_id = ec539d60-a406-4fe9-a658-fbc8b3fb545b file = nexus/src/app/oximeter.rs:76 producer_id = dc04dd71-e9ce-4d94-8637-d87f47eb7409
132832025-03-25T22:11:21.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 37093 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:32825 req_id = b1cd31ce-f7b0-44c8-89f0-7823f480209b response_code = 201 uri = /metrics/producers
132842025-03-25T22:11:21.771ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "b1cd31ce-f7b0-44c8-89f0-7823f480209b", "content-length": "41", "date": "Tue, 25 Mar 2025 22:11:21 GMT"} })
132852025-03-25T22:11:21.773ZDEBGnexus (producer-registration-task): registered with nexus successfully
132862025-03-25T22:11:21.773ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
132872025-03-25T22:11:22.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 62f8fc58-2d62-4513-b7c1-670fa6673065 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
132882025-03-25T22:11:22.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 62f8fc58-2d62-4513-b7c1-670fa6673065 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
132892025-03-25T22:11:22.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2184 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 62f8fc58-2d62-4513-b7c1-670fa6673065 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
132902025-03-25T22:11:23.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a02590e8-9747-4dab-a915-98cd3391346d roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
132912025-03-25T22:11:23.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a02590e8-9747-4dab-a915-98cd3391346d resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
132922025-03-25T22:11:23.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2652 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a02590e8-9747-4dab-a915-98cd3391346d response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
132932025-03-25T22:11:24.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d598c86e-d7a1-4e1a-be6e-72a6c19663b3 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
132942025-03-25T22:11:24.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d598c86e-d7a1-4e1a-be6e-72a6c19663b3 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
132952025-03-25T22:11:24.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2672 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d598c86e-d7a1-4e1a-be6e-72a6c19663b3 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
132962025-03-25T22:11:25.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = bb5b150c-d720-4449-a94f-85ca583526e6 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
132972025-03-25T22:11:25.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = bb5b150c-d720-4449-a94f-85ca583526e6 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
132982025-03-25T22:11:25.448ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2591 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = bb5b150c-d720-4449-a94f-85ca583526e6 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
132992025-03-25T22:11:26.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b26a2fbe-f306-483e-b45d-5077a1324483 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133002025-03-25T22:11:26.467ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b26a2fbe-f306-483e-b45d-5077a1324483 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133012025-03-25T22:11:26.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2760 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b26a2fbe-f306-483e-b45d-5077a1324483 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133022025-03-25T22:11:27.489ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 246f831f-85a2-455a-813f-1c4cbf483388 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133032025-03-25T22:11:27.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 246f831f-85a2-455a-813f-1c4cbf483388 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133042025-03-25T22:11:27.491ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1938 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 246f831f-85a2-455a-813f-1c4cbf483388 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133052025-03-25T22:11:28.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2e1c010f-7c7a-4351-9389-be6f4cfd8d53 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133062025-03-25T22:11:28.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2e1c010f-7c7a-4351-9389-be6f4cfd8d53 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133072025-03-25T22:11:28.513ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2713 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2e1c010f-7c7a-4351-9389-be6f4cfd8d53 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133082025-03-25T22:11:28.573ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 653 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = 82538eb7-20ad-4fcc-b52a-f528d9122341 response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
133092025-03-25T22:11:29.533ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = febc610b-3693-4fd8-b228-4e0f473843e2 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133102025-03-25T22:11:29.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = febc610b-3693-4fd8-b228-4e0f473843e2 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133112025-03-25T22:11:29.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2406 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = febc610b-3693-4fd8-b228-4e0f473843e2 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133122025-03-25T22:11:30.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = eff4a717-5bf8-4118-9b2b-65d82fee7fdd roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133132025-03-25T22:11:30.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = eff4a717-5bf8-4118-9b2b-65d82fee7fdd resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133142025-03-25T22:11:30.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2325 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = eff4a717-5bf8-4118-9b2b-65d82fee7fdd response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133152025-03-25T22:11:30.844ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
133162025-03-25T22:11:30.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
133172025-03-25T22:11:30.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
133182025-03-25T22:11:30.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
133192025-03-25T22:11:30.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
133202025-03-25T22:11:30.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
133212025-03-25T22:11:30.882ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133222025-03-25T22:11:30.885ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
133232025-03-25T22:11:30.885ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
133242025-03-25T22:11:30.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
133252025-03-25T22:11:30.887ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
133262025-03-25T22:11:30.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
133272025-03-25T22:11:30.889ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133282025-03-25T22:11:30.889ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
133292025-03-25T22:11:30.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
133302025-03-25T22:11:30.891ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
133312025-03-25T22:11:30.891ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
133322025-03-25T22:11:30.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
133332025-03-25T22:11:30.892ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 47.419289ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
133342025-03-25T22:11:30.901ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
133352025-03-25T22:11:30.901ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 57.093578ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
133362025-03-25T22:11:31.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4630fa8e-fdf6-441a-a756-9374f01bf8ef roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133372025-03-25T22:11:31.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4630fa8e-fdf6-441a-a756-9374f01bf8ef resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133382025-03-25T22:11:31.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2447 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 4630fa8e-fdf6-441a-a756-9374f01bf8ef response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133392025-03-25T22:11:32.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 63355e0d-6814-4cb4-95bd-e8894215bc29 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133402025-03-25T22:11:32.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 63355e0d-6814-4cb4-95bd-e8894215bc29 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133412025-03-25T22:11:32.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2383 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 63355e0d-6814-4cb4-95bd-e8894215bc29 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133422025-03-25T22:11:33.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a1674a3f-94e4-4f6b-a82a-99acd740007c roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133432025-03-25T22:11:33.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a1674a3f-94e4-4f6b-a82a-99acd740007c resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133442025-03-25T22:11:33.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2589 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a1674a3f-94e4-4f6b-a82a-99acd740007c response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133452025-03-25T22:11:34.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 47da1486-1fe2-4217-a0b8-d11f6608366a roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133462025-03-25T22:11:34.643ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 47da1486-1fe2-4217-a0b8-d11f6608366a resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133472025-03-25T22:11:34.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2494 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 47da1486-1fe2-4217-a0b8-d11f6608366a response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133482025-03-25T22:11:35.665ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3a2028a5-075f-47fe-a593-2b2d58af796e roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133492025-03-25T22:11:35.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3a2028a5-075f-47fe-a593-2b2d58af796e resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133502025-03-25T22:11:35.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2281 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3a2028a5-075f-47fe-a593-2b2d58af796e response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133512025-03-25T22:11:36.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = bf5c0b51-017e-4245-bd3b-9f2bf4b441a5 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133522025-03-25T22:11:36.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = bf5c0b51-017e-4245-bd3b-9f2bf4b441a5 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133532025-03-25T22:11:36.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2329 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = bf5c0b51-017e-4245-bd3b-9f2bf4b441a5 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133542025-03-25T22:11:37.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2928a7b6-a10a-4407-95b4-281a42d1d9ab roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133552025-03-25T22:11:37.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2928a7b6-a10a-4407-95b4-281a42d1d9ab resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133562025-03-25T22:11:37.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2846 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2928a7b6-a10a-4407-95b4-281a42d1d9ab response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133572025-03-25T22:11:38.573ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 559 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = b6543f39-1ec6-4a12-b75d-6891b706a190 response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
133582025-03-25T22:11:38.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1f31609f-3892-429a-8ac2-0078fe5a83cb roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133592025-03-25T22:11:38.732ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1f31609f-3892-429a-8ac2-0078fe5a83cb resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133602025-03-25T22:11:38.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2666 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1f31609f-3892-429a-8ac2-0078fe5a83cb response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133612025-03-25T22:11:39.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 64a00181-b627-47cf-b4ba-bc1171c239d3 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133622025-03-25T22:11:39.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 64a00181-b627-47cf-b4ba-bc1171c239d3 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133632025-03-25T22:11:39.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2373 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 64a00181-b627-47cf-b4ba-bc1171c239d3 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133642025-03-25T22:11:40.773ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5f06acb2-eb17-43d4-b9ec-b7ad43d2a56b roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133652025-03-25T22:11:40.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5f06acb2-eb17-43d4-b9ec-b7ad43d2a56b resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133662025-03-25T22:11:40.776ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2396 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5f06acb2-eb17-43d4-b9ec-b7ad43d2a56b response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133672025-03-25T22:11:40.844ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
133682025-03-25T22:11:40.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
133692025-03-25T22:11:40.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
133702025-03-25T22:11:40.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
133712025-03-25T22:11:40.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
133722025-03-25T22:11:40.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
133732025-03-25T22:11:40.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133742025-03-25T22:11:40.846ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
133752025-03-25T22:11:40.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
133762025-03-25T22:11:40.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
133772025-03-25T22:11:40.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
133782025-03-25T22:11:40.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
133792025-03-25T22:11:40.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
133802025-03-25T22:11:40.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
133812025-03-25T22:11:40.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133822025-03-25T22:11:40.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
133832025-03-25T22:11:40.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
133842025-03-25T22:11:40.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
133852025-03-25T22:11:40.865ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
133862025-03-25T22:11:40.865ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.888265ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
133872025-03-25T22:11:40.877ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.117951ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
133882025-03-25T22:11:41.795ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d3207705-dcae-4d51-9faf-a68edb60b2c7 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133892025-03-25T22:11:41.795ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d3207705-dcae-4d51-9faf-a68edb60b2c7 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133902025-03-25T22:11:41.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2364 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d3207705-dcae-4d51-9faf-a68edb60b2c7 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133912025-03-25T22:11:42.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 135074c6-4842-42df-bc29-e6f2fe785f45 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133922025-03-25T22:11:42.817ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 135074c6-4842-42df-bc29-e6f2fe785f45 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133932025-03-25T22:11:42.819ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2411 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 135074c6-4842-42df-bc29-e6f2fe785f45 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
133942025-03-25T22:11:43.566ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:59278
133952025-03-25T22:11:43.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59278 req_id = 70c5e5b0-711f-4eef-9574-fb4343fe6cc3 roles = RoleSet { roles: {} } uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
133962025-03-25T22:11:43.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59278 req_id = 70c5e5b0-711f-4eef-9574-fb4343fe6cc3 resource = Database result = Ok(()) uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
133972025-03-25T22:11:43.569ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3292 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59278 req_id = 70c5e5b0-711f-4eef-9574-fb4343fe6cc3 response_code = 200 uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
133982025-03-25T22:11:43.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59278 req_id = 2266ef6c-94cc-4e29-9563-0191a2a64f37 roles = RoleSet { roles: {} } uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
133992025-03-25T22:11:43.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59278 req_id = 2266ef6c-94cc-4e29-9563-0191a2a64f37 resource = Database result = Ok(()) uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
134002025-03-25T22:11:43.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2870 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59278 req_id = 2266ef6c-94cc-4e29-9563-0191a2a64f37 response_code = 200 uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
134012025-03-25T22:11:43.839ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 589acabf-dba9-4d83-bfef-c6968fde82a0 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
134022025-03-25T22:11:43.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 589acabf-dba9-4d83-bfef-c6968fde82a0 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
134032025-03-25T22:11:43.841ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2124 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 589acabf-dba9-4d83-bfef-c6968fde82a0 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
134042025-03-25T22:11:44.862ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 65da199d-41a6-4596-9905-a2e0d0b88b2f roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
134052025-03-25T22:11:44.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 65da199d-41a6-4596-9905-a2e0d0b88b2f resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
134062025-03-25T22:11:44.864ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2335 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 65da199d-41a6-4596-9905-a2e0d0b88b2f response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
134072025-03-25T22:11:45.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 9bbacba4-89e1-4cea-bef0-90a8e9323210 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
134082025-03-25T22:11:45.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 9bbacba4-89e1-4cea-bef0-90a8e9323210 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
134092025-03-25T22:11:45.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2579 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 9bbacba4-89e1-4cea-bef0-90a8e9323210 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
134102025-03-25T22:11:46.906ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 89734f1f-d7ad-49b2-a2e1-fba2ae008045 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
134112025-03-25T22:11:46.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 89734f1f-d7ad-49b2-a2e1-fba2ae008045 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
134122025-03-25T22:11:46.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2324 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 89734f1f-d7ad-49b2-a2e1-fba2ae008045 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
134132025-03-25T22:11:47.928ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6a29ee16-1884-435f-9004-3ede389c6f42 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
134142025-03-25T22:11:47.929ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6a29ee16-1884-435f-9004-3ede389c6f42 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
134152025-03-25T22:11:47.931ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2601 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6a29ee16-1884-435f-9004-3ede389c6f42 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
134162025-03-25T22:11:48.573ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 625 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = 5886b457-6606-4d3d-92d7-8b2909fa143a response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
134172025-03-25T22:11:48.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 38f5ac2e-5342-4168-8ca6-14234954cbda roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
134182025-03-25T22:11:48.951ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 38f5ac2e-5342-4168-8ca6-14234954cbda resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
134192025-03-25T22:11:48.952ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2315 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 38f5ac2e-5342-4168-8ca6-14234954cbda response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
134202025-03-25T22:11:49.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ef0960a3-d6fe-4115-a039-1502961f2e82 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
134212025-03-25T22:11:49.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ef0960a3-d6fe-4115-a039-1502961f2e82 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
134222025-03-25T22:11:49.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2581 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ef0960a3-d6fe-4115-a039-1502961f2e82 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
134232025-03-25T22:11:50.844ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
134242025-03-25T22:11:50.844ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
134252025-03-25T22:11:50.844ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
134262025-03-25T22:11:50.844ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 24 reason = Timeout
134272025-03-25T22:11:50.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
134282025-03-25T22:11:50.844ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
134292025-03-25T22:11:50.844ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
134302025-03-25T22:11:50.844ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
134312025-03-25T22:11:50.844ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
134322025-03-25T22:11:50.844ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
134332025-03-25T22:11:50.844ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
134342025-03-25T22:11:50.844ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
134352025-03-25T22:11:50.844ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
134362025-03-25T22:11:50.844ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
134372025-03-25T22:11:50.844ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
134382025-03-25T22:11:50.844ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
134392025-03-25T22:11:50.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
134402025-03-25T22:11:50.844ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
134412025-03-25T22:11:50.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
134422025-03-25T22:11:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
134432025-03-25T22:11:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
134442025-03-25T22:11:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
134452025-03-25T22:11:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
134462025-03-25T22:11:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
134472025-03-25T22:11:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
134482025-03-25T22:11:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
134492025-03-25T22:11:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
134502025-03-25T22:11:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
134512025-03-25T22:11:50.845ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
134522025-03-25T22:11:50.845ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
134532025-03-25T22:11:50.845ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
134542025-03-25T22:11:50.845ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
134552025-03-25T22:11:50.845ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
134562025-03-25T22:11:50.845ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
134572025-03-25T22:11:50.845ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
134582025-03-25T22:11:50.845ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
134592025-03-25T22:11:50.845ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 24 reason = Timeout
134602025-03-25T22:11:50.845ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
134612025-03-25T22:11:50.845ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
134622025-03-25T22:11:50.845ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
134632025-03-25T22:11:50.845ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
134642025-03-25T22:11:50.845ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
134652025-03-25T22:11:50.845ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
134662025-03-25T22:11:50.845ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
134672025-03-25T22:11:50.845ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
134682025-03-25T22:11:50.845ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
134692025-03-25T22:11:50.845ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
134702025-03-25T22:11:50.845ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
134712025-03-25T22:11:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
134722025-03-25T22:11:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
134732025-03-25T22:11:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
134742025-03-25T22:11:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
134752025-03-25T22:11:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
134762025-03-25T22:11:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
134772025-03-25T22:11:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
134782025-03-25T22:11:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
134792025-03-25T22:11:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
134802025-03-25T22:11:50.847ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134812025-03-25T22:11:50.847ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.624243ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
134822025-03-25T22:11:50.848ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134832025-03-25T22:11:50.848ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6864, tv_nsec: 183823639 } })
134842025-03-25T22:11:50.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134852025-03-25T22:11:50.848ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1171
134862025-03-25T22:11:50.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
134872025-03-25T22:11:50.849ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
134882025-03-25T22:11:50.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
134892025-03-25T22:11:50.851ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
134902025-03-25T22:11:50.851ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
134912025-03-25T22:11:50.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
134922025-03-25T22:11:50.851ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
134932025-03-25T22:11:50.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
134942025-03-25T22:11:50.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
134952025-03-25T22:11:50.852ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134962025-03-25T22:11:50.853ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6864, tv_nsec: 189331776 } })
134972025-03-25T22:11:50.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
134982025-03-25T22:11:50.853ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
134992025-03-25T22:11:50.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
135002025-03-25T22:11:50.854ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1171
135012025-03-25T22:11:50.854ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135022025-03-25T22:11:50.856ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135032025-03-25T22:11:50.856ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
135042025-03-25T22:11:50.856ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
135052025-03-25T22:11:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
135062025-03-25T22:11:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
135072025-03-25T22:11:50.857ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
135082025-03-25T22:11:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
135092025-03-25T22:11:50.857ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
135102025-03-25T22:11:50.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
135112025-03-25T22:11:50.858ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
135122025-03-25T22:11:50.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
135132025-03-25T22:11:50.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
135142025-03-25T22:11:50.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
135152025-03-25T22:11:50.860ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6864, tv_nsec: 196147135 } })
135162025-03-25T22:11:50.860ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135172025-03-25T22:11:50.860ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1171 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
135182025-03-25T22:11:50.861ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
135192025-03-25T22:11:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
135202025-03-25T22:11:50.863ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
135212025-03-25T22:11:50.863ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
135222025-03-25T22:11:50.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
135232025-03-25T22:11:50.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135242025-03-25T22:11:50.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
135252025-03-25T22:11:50.869ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
135262025-03-25T22:11:50.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
135272025-03-25T22:11:50.889ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
135282025-03-25T22:11:50.889ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 45.726259ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
135292025-03-25T22:11:50.898ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 53.590447ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
135302025-03-25T22:11:50.908ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
135312025-03-25T22:11:50.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
135322025-03-25T22:11:50.911ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 67.508479ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
135332025-03-25T22:11:50.915ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
135342025-03-25T22:11:50.915ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
135352025-03-25T22:11:50.915ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
135362025-03-25T22:11:50.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
135372025-03-25T22:11:50.916ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135382025-03-25T22:11:50.916ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
135392025-03-25T22:11:50.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
135402025-03-25T22:11:50.919ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 74.141535ms iteration = 24 status = {"errors":[],"finish_invoked_ok":[]}
135412025-03-25T22:11:50.920ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
135422025-03-25T22:11:50.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
135432025-03-25T22:11:50.920ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
135442025-03-25T22:11:50.920ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
135452025-03-25T22:11:50.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
135462025-03-25T22:11:50.925ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
135472025-03-25T22:11:50.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
135482025-03-25T22:11:50.933ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135492025-03-25T22:11:50.933ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 88.399714ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
135502025-03-25T22:11:50.934ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
135512025-03-25T22:11:50.934ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 89.30613ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
135522025-03-25T22:11:50.936ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
135532025-03-25T22:11:50.936ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
135542025-03-25T22:11:50.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
135552025-03-25T22:11:50.936ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 91.376536ms iteration = 24 status = {"errors":[],"requests_created_ok":[]}
135562025-03-25T22:11:50.941ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 95.871564ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
135572025-03-25T22:11:50.953ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
135582025-03-25T22:11:50.953ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
135592025-03-25T22:11:50.954ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dbed92b1-5e93-4062-9b99-e8aeb2bddcac", "content-length": "26", "date": "Tue, 25 Mar 2025 22:11:50 GMT"} })
135602025-03-25T22:11:50.954ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
135612025-03-25T22:11:50.955ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
135622025-03-25T22:11:50.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
135632025-03-25T22:11:50.956ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
135642025-03-25T22:11:50.958ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
135652025-03-25T22:11:50.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
135662025-03-25T22:11:50.960ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135672025-03-25T22:11:50.960ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 zone_address = fd00:1122:3344:101::2
135682025-03-25T22:11:50.960ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
135692025-03-25T22:11:50.960ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9bee91ac-4c06-4dad-8075-a1a0cbf2d1bc", "content-length": "26", "date": "Tue, 25 Mar 2025 22:11:50 GMT"} })
135702025-03-25T22:11:50.960ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1184 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
135712025-03-25T22:11:50.962ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
135722025-03-25T22:11:50.962ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f034aaf6-2037-4cb4-8409-3ab31c15cc28, lookup_type: ById(f034aaf6-2037-4cb4-8409-3ab31c15cc28) } result = Ok(())
135732025-03-25T22:11:50.962ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
135742025-03-25T22:11:50.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
135752025-03-25T22:11:50.964ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 120.459644ms iteration = 24 status = 0
135762025-03-25T22:11:50.979ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
135772025-03-25T22:11:50.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
135782025-03-25T22:11:50.986ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
135792025-03-25T22:11:50.986ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
135802025-03-25T22:11:50.986ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
135812025-03-25T22:11:50.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
135822025-03-25T22:11:50.989ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135832025-03-25T22:11:50.991ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
135842025-03-25T22:11:50.991ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
135852025-03-25T22:11:50.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
135862025-03-25T22:11:50.992ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 14ae481c-78cc-45ea-8a40-2b834a75760f roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
135872025-03-25T22:11:50.992ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
135882025-03-25T22:11:50.992ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 14ae481c-78cc-45ea-8a40-2b834a75760f resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
135892025-03-25T22:11:50.992ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
135902025-03-25T22:11:50.992ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "97a31989-f504-4074-9bf4-b1b0192a4e0c", "content-length": "26", "date": "Tue, 25 Mar 2025 22:11:50 GMT"} })
135912025-03-25T22:11:50.992ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
135922025-03-25T22:11:50.994ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
135932025-03-25T22:11:50.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2855 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 14ae481c-78cc-45ea-8a40-2b834a75760f response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
135942025-03-25T22:11:51.000ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 156.035406ms iteration = 27 status = {"physical_disks_added":0}
135952025-03-25T22:11:51.007ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
135962025-03-25T22:11:51.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
135972025-03-25T22:11:51.020ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
135982025-03-25T22:11:51.020ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
135992025-03-25T22:11:51.020ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 174.769533ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
136002025-03-25T22:11:51.026ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 180.777728ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
136012025-03-25T22:11:51.031ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:360
136022025-03-25T22:11:51.031ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 187.385773ms iteration = 24 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
136032025-03-25T22:11:51.075ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 231.367882ms iteration = 24 status = {}
136042025-03-25T22:11:51.113ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
136052025-03-25T22:11:51.113ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
136062025-03-25T22:11:51.113ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a8e81ce5-7f0e-45c5-8442-691eb07de828", "content-length": "372", "date": "Tue, 25 Mar 2025 22:11:51 GMT"} })
136072025-03-25T22:11:51.113ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
136082025-03-25T22:11:51.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
136092025-03-25T22:11:51.154ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
136102025-03-25T22:11:51.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
136112025-03-25T22:11:51.164ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
136122025-03-25T22:11:51.164ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
136132025-03-25T22:11:51.164ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "34b3dcca-f5fa-4eb7-9801-09a97ac6c737", "date": "Tue, 25 Mar 2025 22:11:51 GMT"} })
136142025-03-25T22:11:51.164ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
136152025-03-25T22:11:51.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
136162025-03-25T22:11:51.166ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
136172025-03-25T22:11:51.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
136182025-03-25T22:11:51.169ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
136192025-03-25T22:11:51.170ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ebbff7ed-5117-4af4-a029-604c32b9ac0d", "content-length": "2", "date": "Tue, 25 Mar 2025 22:11:50 GMT"} })
136202025-03-25T22:11:51.170ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
136212025-03-25T22:11:51.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
136222025-03-25T22:11:51.172ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
136232025-03-25T22:11:51.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
136242025-03-25T22:11:51.174ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 330.133737ms iteration = 24 status = null
136252025-03-25T22:11:51.174ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
136262025-03-25T22:11:51.174ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
136272025-03-25T22:11:51.174ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7807b358-f3e5-4827-8bf5-787a20ca6218", "date": "Tue, 25 Mar 2025 22:11:51 GMT"} })
136282025-03-25T22:11:51.176ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 331.572872ms iteration = 25 status = {}
136292025-03-25T22:11:51.187ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136302025-03-25T22:11:51.189ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
136312025-03-25T22:11:51.189ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
136322025-03-25T22:11:51.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
136332025-03-25T22:11:51.228ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136342025-03-25T22:11:51.230ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
136352025-03-25T22:11:51.230ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
136362025-03-25T22:11:51.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
136372025-03-25T22:11:51.231ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
136382025-03-25T22:11:51.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
136392025-03-25T22:11:51.233ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a5db250-fa3f-4168-ab16-5c36568c22e2, rack_id: c7210e4b-5a81-4ec8-b8fe-816a9508dc74, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(6d5dda50-e3c4-4853-9bfa-a66b447ab351) } rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
136402025-03-25T22:11:51.233ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
136412025-03-25T22:11:51.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
136422025-03-25T22:11:51.243ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
136432025-03-25T22:11:51.243ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d2b9e600-0d04-4494-a713-a1e81932cfd9", "content-length": "134", "date": "Tue, 25 Mar 2025 22:11:50 GMT"} })
136442025-03-25T22:11:51.243ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
136452025-03-25T22:11:51.243ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 6d5dda50-e3c4-4853-9bfa-a66b447ab351
136462025-03-25T22:11:51.243ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
136472025-03-25T22:11:51.243ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
136482025-03-25T22:11:51.243ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
136492025-03-25T22:11:51.243ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
136502025-03-25T22:11:51.243ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
136512025-03-25T22:11:51.243ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
136522025-03-25T22:11:51.244ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
136532025-03-25T22:11:51.244ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
136542025-03-25T22:11:51.244ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
136552025-03-25T22:11:51.244ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
136562025-03-25T22:11:51.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
136572025-03-25T22:11:51.246ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
136582025-03-25T22:11:51.246ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "6472920d-a5eb-44d2-9b71-7a30b0c046d8", "content-length": "2", "date": "Tue, 25 Mar 2025 22:11:50 GMT"} })
136592025-03-25T22:11:51.246ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
136602025-03-25T22:11:51.247ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "817ff626-e213-4f15-9042-a37e37783c4d", "content-length": "52", "date": "Tue, 25 Mar 2025 22:11:50 GMT"} })
136612025-03-25T22:11:51.247ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
136622025-03-25T22:11:51.247ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
136632025-03-25T22:11:51.320ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
136642025-03-25T22:11:51.354ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "651efee6-2ed1-44be-95a7-2fe8ae0cabea", "date": "Tue, 25 Mar 2025 22:11:51 GMT"} })
136652025-03-25T22:11:51.354ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch = Switch0
136662025-03-25T22:11:51.354ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
136672025-03-25T22:11:51.354ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e2024c2-519c-4421-8f79-dac86c05d8b3", "content-length": "682", "date": "Tue, 25 Mar 2025 22:11:51 GMT"} })
136682025-03-25T22:11:51.354ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
136692025-03-25T22:11:51.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
136702025-03-25T22:11:51.358ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
136712025-03-25T22:11:51.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
136722025-03-25T22:11:51.358ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "6efcbc95-f778-421e-909e-0994dc049191", "content-length": "691", "date": "Tue, 25 Mar 2025 22:11:51 GMT"} })
136732025-03-25T22:11:51.358ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
136742025-03-25T22:11:51.358ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
136752025-03-25T22:11:51.359ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
136762025-03-25T22:11:51.360ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 516.531333ms iteration = 25 status = {}
136772025-03-25T22:11:51.361ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
136782025-03-25T22:11:51.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
136792025-03-25T22:11:51.363ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
136802025-03-25T22:11:51.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
136812025-03-25T22:11:51.370ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 526.445596ms iteration = 24 status = {}
136822025-03-25T22:11:52.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a9f71352-a4e5-4e45-b0df-a16712225be6 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
136832025-03-25T22:11:52.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a9f71352-a4e5-4e45-b0df-a16712225be6 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
136842025-03-25T22:11:52.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2427 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a9f71352-a4e5-4e45-b0df-a16712225be6 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
136852025-03-25T22:11:53.043ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = bce8b9b9-cbcf-4060-8e60-465808811486 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
136862025-03-25T22:11:53.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = bce8b9b9-cbcf-4060-8e60-465808811486 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
136872025-03-25T22:11:53.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2945 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = bce8b9b9-cbcf-4060-8e60-465808811486 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
136882025-03-25T22:11:54.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 66bcbcf6-4d00-4e24-87bc-a31fe7647b96 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
136892025-03-25T22:11:54.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 66bcbcf6-4d00-4e24-87bc-a31fe7647b96 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
136902025-03-25T22:11:54.069ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3109 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 66bcbcf6-4d00-4e24-87bc-a31fe7647b96 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
136912025-03-25T22:11:55.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = dd49e472-edab-4d31-b908-5badd6e69d37 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
136922025-03-25T22:11:55.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = dd49e472-edab-4d31-b908-5badd6e69d37 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
136932025-03-25T22:11:55.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2511 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = dd49e472-edab-4d31-b908-5badd6e69d37 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
136942025-03-25T22:11:56.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7df23fb2-03d6-48fc-9699-6c4763c22316 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
136952025-03-25T22:11:56.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7df23fb2-03d6-48fc-9699-6c4763c22316 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
136962025-03-25T22:11:56.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3249 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 7df23fb2-03d6-48fc-9699-6c4763c22316 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
136972025-03-25T22:11:57.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5ac19851-dc7f-4c61-9f10-8ad61269ff34 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
136982025-03-25T22:11:57.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5ac19851-dc7f-4c61-9f10-8ad61269ff34 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
136992025-03-25T22:11:57.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2683 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5ac19851-dc7f-4c61-9f10-8ad61269ff34 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
137002025-03-25T22:11:58.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = bf453011-b896-4681-ae3b-a40d3ac0f628 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
137012025-03-25T22:11:58.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = bf453011-b896-4681-ae3b-a40d3ac0f628 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
137022025-03-25T22:11:58.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2227 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = bf453011-b896-4681-ae3b-a40d3ac0f628 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
137032025-03-25T22:11:58.573ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 606 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = 96be47d3-78d0-4922-8e7e-a01199b0e7eb response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
137042025-03-25T22:11:59.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c523fcd0-38fa-455a-af7f-1fc177ff322d roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
137052025-03-25T22:11:59.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c523fcd0-38fa-455a-af7f-1fc177ff322d resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
137062025-03-25T22:11:59.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2284 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c523fcd0-38fa-455a-af7f-1fc177ff322d response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
137072025-03-25T22:12:00.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = eba94ef9-d5eb-495a-8f00-6fd3c700c9a5 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
137082025-03-25T22:12:00.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = eba94ef9-d5eb-495a-8f00-6fd3c700c9a5 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
137092025-03-25T22:12:00.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1935 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = eba94ef9-d5eb-495a-8f00-6fd3c700c9a5 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
137102025-03-25T22:12:00.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
137112025-03-25T22:12:00.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
137122025-03-25T22:12:00.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
137132025-03-25T22:12:00.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
137142025-03-25T22:12:00.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
137152025-03-25T22:12:00.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
137162025-03-25T22:12:00.872ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137172025-03-25T22:12:00.874ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
137182025-03-25T22:12:00.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
137192025-03-25T22:12:00.876ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
137202025-03-25T22:12:00.876ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
137212025-03-25T22:12:00.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
137222025-03-25T22:12:00.879ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
137232025-03-25T22:12:00.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
137242025-03-25T22:12:00.880ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137252025-03-25T22:12:00.884ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
137262025-03-25T22:12:00.884ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
137272025-03-25T22:12:00.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
137282025-03-25T22:12:00.894ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
137292025-03-25T22:12:00.894ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.281289ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
137302025-03-25T22:12:00.905ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.527288ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
137312025-03-25T22:12:01.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 26666045-60a2-4832-910d-3985224ab89f roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
137322025-03-25T22:12:01.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 26666045-60a2-4832-910d-3985224ab89f resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
137332025-03-25T22:12:01.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2062 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 26666045-60a2-4832-910d-3985224ab89f response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
137342025-03-25T22:12:02.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8923bd88-90dc-4552-90c7-40ee79e67714 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
137352025-03-25T22:12:02.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8923bd88-90dc-4552-90c7-40ee79e67714 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
137362025-03-25T22:12:02.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2667 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8923bd88-90dc-4552-90c7-40ee79e67714 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
137372025-03-25T22:12:03.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8ae51588-c82a-46f4-af1a-fa852b061e40 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
137382025-03-25T22:12:03.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8ae51588-c82a-46f4-af1a-fa852b061e40 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
137392025-03-25T22:12:03.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2274 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8ae51588-c82a-46f4-af1a-fa852b061e40 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
137402025-03-25T22:12:04.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 569a3a34-f6b0-459e-9a92-c21228ad827f roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
137412025-03-25T22:12:04.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 569a3a34-f6b0-459e-9a92-c21228ad827f resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
137422025-03-25T22:12:04.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2258 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 569a3a34-f6b0-459e-9a92-c21228ad827f response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
137432025-03-25T22:12:05.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 66c01a0b-5e0a-4883-ab88-2dc71901d5f3 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
137442025-03-25T22:12:05.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 66c01a0b-5e0a-4883-ab88-2dc71901d5f3 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
137452025-03-25T22:12:05.311ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2174 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 66c01a0b-5e0a-4883-ab88-2dc71901d5f3 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
137462025-03-25T22:12:06.331ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6e811c1e-743e-4030-8230-eb239fe55d42 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
137472025-03-25T22:12:06.332ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6e811c1e-743e-4030-8230-eb239fe55d42 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
137482025-03-25T22:12:06.334ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2761 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6e811c1e-743e-4030-8230-eb239fe55d42 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
137492025-03-25T22:12:07.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1bfd9977-54e0-4938-9b16-8316711413df roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
137502025-03-25T22:12:07.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1bfd9977-54e0-4938-9b16-8316711413df resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
137512025-03-25T22:12:07.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2495 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1bfd9977-54e0-4938-9b16-8316711413df response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
137522025-03-25T22:12:08.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = db03d0a4-9ad3-47dd-bffd-463460540361 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
137532025-03-25T22:12:08.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = db03d0a4-9ad3-47dd-bffd-463460540361 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
137542025-03-25T22:12:08.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2565 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = db03d0a4-9ad3-47dd-bffd-463460540361 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
137552025-03-25T22:12:08.573ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 957 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = c4608adb-d49f-454d-94ee-29656e02acdb response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
137562025-03-25T22:12:09.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c66b0e01-e636-4f5b-bf2c-1cc1897121b1 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
137572025-03-25T22:12:09.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c66b0e01-e636-4f5b-bf2c-1cc1897121b1 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
137582025-03-25T22:12:09.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1942 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c66b0e01-e636-4f5b-bf2c-1cc1897121b1 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
137592025-03-25T22:12:10.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 39f6bc40-7978-40a5-86bf-7ac2733cdfd0 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
137602025-03-25T22:12:10.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 39f6bc40-7978-40a5-86bf-7ac2733cdfd0 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
137612025-03-25T22:12:10.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2693 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 39f6bc40-7978-40a5-86bf-7ac2733cdfd0 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
137622025-03-25T22:12:10.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
137632025-03-25T22:12:10.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
137642025-03-25T22:12:10.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
137652025-03-25T22:12:10.845ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
137662025-03-25T22:12:10.845ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
137672025-03-25T22:12:10.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
137682025-03-25T22:12:10.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137692025-03-25T22:12:10.846ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
137702025-03-25T22:12:10.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
137712025-03-25T22:12:10.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
137722025-03-25T22:12:10.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
137732025-03-25T22:12:10.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
137742025-03-25T22:12:10.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
137752025-03-25T22:12:10.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
137762025-03-25T22:12:10.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137772025-03-25T22:12:10.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
137782025-03-25T22:12:10.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
137792025-03-25T22:12:10.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
137802025-03-25T22:12:10.863ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
137812025-03-25T22:12:10.863ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.353188ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
137822025-03-25T22:12:10.887ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 42.456371ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
137832025-03-25T22:12:11.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 66c08a9f-b7ef-46fa-abfb-b305edd3583d roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
137842025-03-25T22:12:11.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 66c08a9f-b7ef-46fa-abfb-b305edd3583d resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
137852025-03-25T22:12:11.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2359 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 66c08a9f-b7ef-46fa-abfb-b305edd3583d response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
137862025-03-25T22:12:12.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 942843cb-3348-4d65-bcdb-8571c6553961 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
137872025-03-25T22:12:12.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 942843cb-3348-4d65-bcdb-8571c6553961 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
137882025-03-25T22:12:12.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2887 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 942843cb-3348-4d65-bcdb-8571c6553961 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
137892025-03-25T22:12:13.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = fefbf833-340c-4f4e-987f-53480dc65605 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
137902025-03-25T22:12:13.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = fefbf833-340c-4f4e-987f-53480dc65605 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
137912025-03-25T22:12:13.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1851 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = fefbf833-340c-4f4e-987f-53480dc65605 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
137922025-03-25T22:12:13.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59278 req_id = 48c6d7d6-9d17-4f02-a328-a412811bf27c roles = RoleSet { roles: {} } uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
137932025-03-25T22:12:13.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59278 req_id = 48c6d7d6-9d17-4f02-a328-a412811bf27c resource = Database result = Ok(()) uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
137942025-03-25T22:12:13.569ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3699 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59278 req_id = 48c6d7d6-9d17-4f02-a328-a412811bf27c response_code = 200 uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
137952025-03-25T22:12:13.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59278 req_id = 3d46b5eb-1a5f-4ca6-bf97-6d844b9032d2 roles = RoleSet { roles: {} } uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
137962025-03-25T22:12:13.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59278 req_id = 3d46b5eb-1a5f-4ca6-bf97-6d844b9032d2 resource = Database result = Ok(()) uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
137972025-03-25T22:12:13.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2463 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59278 req_id = 3d46b5eb-1a5f-4ca6-bf97-6d844b9032d2 response_code = 200 uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
137982025-03-25T22:12:14.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ce9baa57-e770-424b-9f30-07e2b727c9fd roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
137992025-03-25T22:12:14.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ce9baa57-e770-424b-9f30-07e2b727c9fd resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
138002025-03-25T22:12:14.512ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2467 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ce9baa57-e770-424b-9f30-07e2b727c9fd response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
138012025-03-25T22:12:15.533ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 738da85f-a144-44b6-a551-55cf2132660c roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
138022025-03-25T22:12:15.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 738da85f-a144-44b6-a551-55cf2132660c resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
138032025-03-25T22:12:15.536ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2481 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 738da85f-a144-44b6-a551-55cf2132660c response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
138042025-03-25T22:12:16.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a327b504-f2c8-4114-9bd2-3176d6e745f4 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
138052025-03-25T22:12:16.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a327b504-f2c8-4114-9bd2-3176d6e745f4 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
138062025-03-25T22:12:16.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2493 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a327b504-f2c8-4114-9bd2-3176d6e745f4 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
138072025-03-25T22:12:17.578ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a685d31a-db1b-4ed6-8012-59e1b1d70906 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
138082025-03-25T22:12:17.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a685d31a-db1b-4ed6-8012-59e1b1d70906 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
138092025-03-25T22:12:17.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2585 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a685d31a-db1b-4ed6-8012-59e1b1d70906 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
138102025-03-25T22:12:18.574ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 928 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = 4aa92442-7eef-4e22-b933-85ae325874ca response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
138112025-03-25T22:12:18.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0056560b-878f-412d-99bf-575d7c4c0a86 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
138122025-03-25T22:12:18.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0056560b-878f-412d-99bf-575d7c4c0a86 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
138132025-03-25T22:12:18.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2293 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0056560b-878f-412d-99bf-575d7c4c0a86 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
138142025-03-25T22:12:19.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3b2c5a62-f6b4-41b0-a8e5-c9892567d588 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
138152025-03-25T22:12:19.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3b2c5a62-f6b4-41b0-a8e5-c9892567d588 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
138162025-03-25T22:12:19.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2536 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3b2c5a62-f6b4-41b0-a8e5-c9892567d588 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
138172025-03-25T22:12:20.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 9afb0788-0637-4f5e-9529-b620999abd96 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
138182025-03-25T22:12:20.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 9afb0788-0637-4f5e-9529-b620999abd96 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
138192025-03-25T22:12:20.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2454 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 9afb0788-0637-4f5e-9529-b620999abd96 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
138202025-03-25T22:12:20.844ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
138212025-03-25T22:12:20.844ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
138222025-03-25T22:12:20.844ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
138232025-03-25T22:12:20.844ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
138242025-03-25T22:12:20.844ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
138252025-03-25T22:12:20.844ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
138262025-03-25T22:12:20.844ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
138272025-03-25T22:12:20.844ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
138282025-03-25T22:12:20.844ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
138292025-03-25T22:12:20.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
138302025-03-25T22:12:20.844ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:82 reason = blueprint disabled target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7
138312025-03-25T22:12:20.844ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
138322025-03-25T22:12:20.844ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 19.74\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7"}
138332025-03-25T22:12:20.844ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
138342025-03-25T22:12:20.844ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Timeout
138352025-03-25T22:12:20.844ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
138362025-03-25T22:12:20.844ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
138372025-03-25T22:12:20.844ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-03-25 22:02:20.844370232 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
138382025-03-25T22:12:20.844ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
138392025-03-25T22:12:20.844ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
138402025-03-25T22:12:20.844ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
138412025-03-25T22:12:20.844ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
138422025-03-25T22:12:20.844ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
138432025-03-25T22:12:20.844ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
138442025-03-25T22:12:20.844ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
138452025-03-25T22:12:20.844ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
138462025-03-25T22:12:20.844ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
138472025-03-25T22:12:20.844ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
138482025-03-25T22:12:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
138492025-03-25T22:12:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
138502025-03-25T22:12:20.844ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
138512025-03-25T22:12:20.844ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
138522025-03-25T22:12:20.844ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
138532025-03-25T22:12:20.844ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
138542025-03-25T22:12:20.844ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
138552025-03-25T22:12:20.844ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 25 reason = Timeout
138562025-03-25T22:12:20.844ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
138572025-03-25T22:12:20.844ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
138582025-03-25T22:12:20.844ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
138592025-03-25T22:12:20.844ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
138602025-03-25T22:12:20.844ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
138612025-03-25T22:12:20.844ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
138622025-03-25T22:12:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
138632025-03-25T22:12:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
138642025-03-25T22:12:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
138652025-03-25T22:12:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
138662025-03-25T22:12:20.844ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
138672025-03-25T22:12:20.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
138682025-03-25T22:12:20.844ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
138692025-03-25T22:12:20.844ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
138702025-03-25T22:12:20.844ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
138712025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
138722025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
138732025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 25 reason = Timeout
138742025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
138752025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
138762025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
138772025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
138782025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
138792025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
138802025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
138812025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
138822025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
138832025-03-25T22:12:20.845ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
138842025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
138852025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
138862025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
138872025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
138882025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
138892025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
138902025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
138912025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
138922025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
138932025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
138942025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
138952025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
138962025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
138972025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
138982025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
138992025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
139002025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
139012025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
139022025-03-25T22:12:20.845ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5533f428-2028-4269-b7b1-f15912c01133.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("66b022b6-2e12-413e-b4b7-56c4ad5bdd77.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f337d25b-c67a-4a32-89e1-e187aea97ed9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f337d25b-c67a-4a32-89e1-e187aea97ed9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 6894, tv_nsec: 180824227 } })
139032025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
139042025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
139052025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
139062025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
139072025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
139082025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
139092025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
139102025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
139112025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
139122025-03-25T22:12:20.845ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("58d382a7-99da-40a7-bc9f-2da7e9b156c1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d42076c6-06fe-4102-a978-c7d0a8dffb98.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d42076c6-06fe-4102-a978-c7d0a8dffb98.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 6894, tv_nsec: 180937539 } })
139132025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
139142025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
139152025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
139162025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
139172025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
139182025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
139192025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
139202025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
139212025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
139222025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
139232025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
139242025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
139252025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
139262025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.577467ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
139272025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
139282025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
139292025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
139302025-03-25T22:12:20.845ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.493227ms iteration = 13 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
139312025-03-25T22:12:20.847ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6894, tv_nsec: 183507574 } })
139322025-03-25T22:12:20.848ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6894, tv_nsec: 183613386 } })
139332025-03-25T22:12:20.848ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1171
139342025-03-25T22:12:20.848ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1171
139352025-03-25T22:12:20.848ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-03-25 22:02:20.844370232 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
139362025-03-25T22:12:20.848ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.123952ms iteration = 13 status = {"expiration":"2025-03-25T22:02:20.844370232Z","pruned":[]}
139372025-03-25T22:12:20.848ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.621431ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
139382025-03-25T22:12:20.849ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139392025-03-25T22:12:20.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139402025-03-25T22:12:20.850ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139412025-03-25T22:12:20.851ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
139422025-03-25T22:12:20.851ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
139432025-03-25T22:12:20.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
139442025-03-25T22:12:20.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
139452025-03-25T22:12:20.853ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
139462025-03-25T22:12:20.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
139472025-03-25T22:12:20.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
139482025-03-25T22:12:20.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
139492025-03-25T22:12:20.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
139502025-03-25T22:12:20.854ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
139512025-03-25T22:12:20.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
139522025-03-25T22:12:20.856ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139532025-03-25T22:12:20.856ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139542025-03-25T22:12:20.858ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
139552025-03-25T22:12:20.858ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
139562025-03-25T22:12:20.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
139572025-03-25T22:12:20.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
139582025-03-25T22:12:20.860ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
139592025-03-25T22:12:20.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
139602025-03-25T22:12:20.862ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
139612025-03-25T22:12:20.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
139622025-03-25T22:12:20.864ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 19.48767ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
139632025-03-25T22:12:20.865ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139642025-03-25T22:12:20.868ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139652025-03-25T22:12:20.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
139662025-03-25T22:12:20.868ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
139672025-03-25T22:12:20.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
139682025-03-25T22:12:20.871ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
139692025-03-25T22:12:20.874ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139702025-03-25T22:12:20.877ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
139712025-03-25T22:12:20.877ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
139722025-03-25T22:12:20.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
139732025-03-25T22:12:20.887ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6894, tv_nsec: 222837151 } })
139742025-03-25T22:12:20.887ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1171 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
139752025-03-25T22:12:20.916ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
139762025-03-25T22:12:20.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
139772025-03-25T22:12:20.918ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
139782025-03-25T22:12:20.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
139792025-03-25T22:12:20.920ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139802025-03-25T22:12:20.921ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139812025-03-25T22:12:20.923ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139822025-03-25T22:12:20.923ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 78.674084ms iteration = 25 status = {"errors":[],"finish_invoked_ok":[]}
139832025-03-25T22:12:20.923ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
139842025-03-25T22:12:20.923ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
139852025-03-25T22:12:20.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
139862025-03-25T22:12:20.924ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
139872025-03-25T22:12:20.924ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
139882025-03-25T22:12:20.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
139892025-03-25T22:12:20.925ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139902025-03-25T22:12:20.926ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
139912025-03-25T22:12:20.926ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
139922025-03-25T22:12:20.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
139932025-03-25T22:12:20.927ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139942025-03-25T22:12:20.928ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
139952025-03-25T22:12:20.928ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
139962025-03-25T22:12:20.929ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
139972025-03-25T22:12:20.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
139982025-03-25T22:12:20.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
139992025-03-25T22:12:20.930ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
140002025-03-25T22:12:20.930ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
140012025-03-25T22:12:20.930ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
140022025-03-25T22:12:20.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
140032025-03-25T22:12:20.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
140042025-03-25T22:12:20.933ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
140052025-03-25T22:12:20.933ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
140062025-03-25T22:12:20.933ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
140072025-03-25T22:12:20.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
140082025-03-25T22:12:20.934ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 89.700407ms iteration = 25 status = {"errors":[],"requests_created_ok":[]}
140092025-03-25T22:12:20.934ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140102025-03-25T22:12:20.936ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 91.457128ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
140112025-03-25T22:12:20.937ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
140122025-03-25T22:12:20.937ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
140132025-03-25T22:12:20.937ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
140142025-03-25T22:12:20.937ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
140152025-03-25T22:12:20.937ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
140162025-03-25T22:12:20.937ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
140172025-03-25T22:12:20.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
140182025-03-25T22:12:20.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
140192025-03-25T22:12:20.938ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
140202025-03-25T22:12:20.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
140212025-03-25T22:12:20.938ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
140222025-03-25T22:12:20.938ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
140232025-03-25T22:12:20.938ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 93.767078ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
140242025-03-25T22:12:20.939ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
140252025-03-25T22:12:20.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
140262025-03-25T22:12:20.941ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140272025-03-25T22:12:20.943ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
140282025-03-25T22:12:20.943ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
140292025-03-25T22:12:20.943ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
140302025-03-25T22:12:20.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
140312025-03-25T22:12:20.944ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
140322025-03-25T22:12:20.944ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
140332025-03-25T22:12:20.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
140342025-03-25T22:12:20.944ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140352025-03-25T22:12:20.945ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
140362025-03-25T22:12:20.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
140372025-03-25T22:12:20.948ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
140382025-03-25T22:12:20.948ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
140392025-03-25T22:12:20.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
140402025-03-25T22:12:20.951ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140412025-03-25T22:12:20.955ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
140422025-03-25T22:12:20.955ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
140432025-03-25T22:12:20.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
140442025-03-25T22:12:20.963ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
140452025-03-25T22:12:20.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
140462025-03-25T22:12:20.965ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 120.815111ms iteration = 6 status = {"nsuccess":5}
140472025-03-25T22:12:20.972ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140482025-03-25T22:12:20.977ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
140492025-03-25T22:12:20.977ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
140502025-03-25T22:12:20.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
140512025-03-25T22:12:20.988ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
140522025-03-25T22:12:20.988ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140532025-03-25T22:12:20.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
140542025-03-25T22:12:20.989ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
140552025-03-25T22:12:20.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
140562025-03-25T22:12:20.993ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
140572025-03-25T22:12:20.999ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 154.641022ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
140582025-03-25T22:12:21.000ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
140592025-03-25T22:12:21.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
140602025-03-25T22:12:21.001ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
140612025-03-25T22:12:21.001ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
140622025-03-25T22:12:21.002ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "065743ac-542e-4122-bae6-7444fa941439", "content-length": "26", "date": "Tue, 25 Mar 2025 22:12:21 GMT"} })
140632025-03-25T22:12:21.002ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
140642025-03-25T22:12:21.002ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
140652025-03-25T22:12:21.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
140662025-03-25T22:12:21.003ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
140672025-03-25T22:12:21.004ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
140682025-03-25T22:12:21.004ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
140692025-03-25T22:12:21.004ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 159.859623ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
140702025-03-25T22:12:21.004ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140712025-03-25T22:12:21.004ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140722025-03-25T22:12:21.006ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 162.342465ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
140732025-03-25T22:12:21.009ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
140742025-03-25T22:12:21.009ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
140752025-03-25T22:12:21.009ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f034aaf6-2037-4cb4-8409-3ab31c15cc28, lookup_type: ById(f034aaf6-2037-4cb4-8409-3ab31c15cc28) } result = Ok(())
140762025-03-25T22:12:21.009ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
140772025-03-25T22:12:21.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
140782025-03-25T22:12:21.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
140792025-03-25T22:12:21.014ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 170.03038ms iteration = 25 status = 0
140802025-03-25T22:12:21.016ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
140812025-03-25T22:12:21.016ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 172.27809ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
140822025-03-25T22:12:21.022ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
140832025-03-25T22:12:21.022ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
140842025-03-25T22:12:21.022ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 178.03847ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
140852025-03-25T22:12:21.024ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140862025-03-25T22:12:21.025ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 180.702657ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
140872025-03-25T22:12:21.027ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
140882025-03-25T22:12:21.027ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 182.752743ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
140892025-03-25T22:12:21.027ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
140902025-03-25T22:12:21.027ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
140912025-03-25T22:12:21.027ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140922025-03-25T22:12:21.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
140932025-03-25T22:12:21.031ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
140942025-03-25T22:12:21.031ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
140952025-03-25T22:12:21.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
140962025-03-25T22:12:21.033ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
140972025-03-25T22:12:21.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
140982025-03-25T22:12:21.034ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 zone_address = fd00:1122:3344:101::2
140992025-03-25T22:12:21.034ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
141002025-03-25T22:12:21.034ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c652b92e-7ad3-4aa4-a3ef-3f817170b41d", "content-length": "26", "date": "Tue, 25 Mar 2025 22:12:21 GMT"} })
141012025-03-25T22:12:21.034ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1184 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
141022025-03-25T22:12:21.035ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
141032025-03-25T22:12:21.035ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
141042025-03-25T22:12:21.035ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
141052025-03-25T22:12:21.035ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d7513ed-149d-4d79-af1f-b90840716e43", "content-length": "26", "date": "Tue, 25 Mar 2025 22:12:21 GMT"} })
141062025-03-25T22:12:21.035ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
141072025-03-25T22:12:21.036ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
141082025-03-25T22:12:21.036ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
141092025-03-25T22:12:21.037ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
141102025-03-25T22:12:21.037ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
141112025-03-25T22:12:21.037ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
141122025-03-25T22:12:21.037ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
141132025-03-25T22:12:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
141142025-03-25T22:12:21.038ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:360
141152025-03-25T22:12:21.038ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 194.005609ms iteration = 25 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
141162025-03-25T22:12:21.052ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
141172025-03-25T22:12:21.052ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
141182025-03-25T22:12:21.052ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
141192025-03-25T22:12:21.052ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
141202025-03-25T22:12:21.052ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
141212025-03-25T22:12:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
141222025-03-25T22:12:21.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
141232025-03-25T22:12:21.058ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
141242025-03-25T22:12:21.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
141252025-03-25T22:12:21.063ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
141262025-03-25T22:12:21.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
141272025-03-25T22:12:21.064ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 219.85309ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
141282025-03-25T22:12:21.081ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
141292025-03-25T22:12:21.081ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 96679ce4-e18c-487b-803a-7b26be55e85c dns_zone_name = oxide.test found_so_far = 0 version = 2
141302025-03-25T22:12:21.081ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
141312025-03-25T22:12:21.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
141322025-03-25T22:12:21.106ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-03-25T22:00:16.382271Z, time_modified: 2025-03-25T22:00:16.382271Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, db_silo: Silo { identity: SiloIdentity { id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-25T22:00:22.501108Z, time_modified: 2025-03-25T22:00:22.501108Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, db_silo: Silo { identity: SiloIdentity { id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-25T22:00:22.501108Z, time_modified: 2025-03-25T22:00:22.501108Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d" }] }) }
141332025-03-25T22:12:21.106ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 261.905155ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"5c35ff8c-21dd-48b9-9751-76bfa681bc38","tls_certs":["0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d"]}},"default_endpoint":{"silo_id":"5c35ff8c-21dd-48b9-9751-76bfa681bc38","tls_certs":["0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
141342025-03-25T22:12:21.134ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
141352025-03-25T22:12:21.134ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 23d93905-7b89-4296-b050-7ff9ae235c15 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
141362025-03-25T22:12:21.134ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
141372025-03-25T22:12:21.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
141382025-03-25T22:12:21.136ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
141392025-03-25T22:12:21.140ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
141402025-03-25T22:12:21.141ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
141412025-03-25T22:12:21.141ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
141422025-03-25T22:12:21.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
141432025-03-25T22:12:21.144ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 23d93905-7b89-4296-b050-7ff9ae235c15 dns_zone_name = control-plane.oxide.internal found_so_far = 52 version = 1
141442025-03-25T22:12:21.144ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
141452025-03-25T22:12:21.144ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-03-25 22:00:21.368103 UTC dns_group = internal generation = 1
141462025-03-25T22:12:21.144ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 300.250795ms iteration = 13 status = {"generation":1}
141472025-03-25T22:12:21.145ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
141482025-03-25T22:12:21.145ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
141492025-03-25T22:12:21.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
141502025-03-25T22:12:21.147ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 96679ce4-e18c-487b-803a-7b26be55e85c dns_zone_name = oxide.test found_so_far = 1 version = 2
141512025-03-25T22:12:21.147ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
141522025-03-25T22:12:21.147ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-03-25 22:00:22.561696 UTC dns_group = external generation = 2
141532025-03-25T22:12:21.147ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 303.099945ms iteration = 13 status = {"generation":2}
141542025-03-25T22:12:21.188ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 344.355125ms iteration = 25 status = {}
141552025-03-25T22:12:21.195ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
141562025-03-25T22:12:21.195ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 350.796698ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
141572025-03-25T22:12:21.198ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 353.694089ms iteration = 28 status = {"physical_disks_added":0}
141582025-03-25T22:12:21.207ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
141592025-03-25T22:12:21.207ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc412627-51bd-4b88-8e05-d9b5039a3e5c", "content-length": "2", "date": "Tue, 25 Mar 2025 22:12:21 GMT"} })
141602025-03-25T22:12:21.209ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
141612025-03-25T22:12:21.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
141622025-03-25T22:12:21.215ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
141632025-03-25T22:12:21.215ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
141642025-03-25T22:12:21.215ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "f8424c08-3177-43cb-94b4-97c6f1f95015", "date": "Tue, 25 Mar 2025 22:12:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
141652025-03-25T22:12:21.215ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
141662025-03-25T22:12:21.217ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "20bddc3d-def3-4d12-99f9-d0c77f52bf70", "date": "Tue, 25 Mar 2025 22:12:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
141672025-03-25T22:12:21.217ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
141682025-03-25T22:12:21.218ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
141692025-03-25T22:12:21.218ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 374.610314ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
141702025-03-25T22:12:21.235ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
141712025-03-25T22:12:21.235ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
141722025-03-25T22:12:21.236ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8389bad-e3f5-4435-86de-af7b9970fa1f", "content-length": "372", "date": "Tue, 25 Mar 2025 22:12:21 GMT"} })
141732025-03-25T22:12:21.236ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
141742025-03-25T22:12:21.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
141752025-03-25T22:12:21.237ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
141762025-03-25T22:12:21.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
141772025-03-25T22:12:21.238ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 394.038003ms iteration = 25 status = null
141782025-03-25T22:12:21.239ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
141792025-03-25T22:12:21.241ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
141802025-03-25T22:12:21.241ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
141812025-03-25T22:12:21.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
141822025-03-25T22:12:21.242ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
141832025-03-25T22:12:21.245ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
141842025-03-25T22:12:21.245ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
141852025-03-25T22:12:21.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
141862025-03-25T22:12:21.279ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
141872025-03-25T22:12:21.279ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
141882025-03-25T22:12:21.279ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "117b560f-d1ad-4d49-a9e2-03b1357b6197", "date": "Tue, 25 Mar 2025 22:12:21 GMT"} })
141892025-03-25T22:12:21.279ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
141902025-03-25T22:12:21.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
141912025-03-25T22:12:21.282ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
141922025-03-25T22:12:21.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
141932025-03-25T22:12:21.285ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
141942025-03-25T22:12:21.285ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
141952025-03-25T22:12:21.285ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "ba922ef5-6d50-43e8-8489-23a531ea61e9", "date": "Tue, 25 Mar 2025 22:12:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
141962025-03-25T22:12:21.285ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
141972025-03-25T22:12:21.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
141982025-03-25T22:12:21.288ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "5f66ad65-ac52-464b-934a-47d698ca841d", "date": "Tue, 25 Mar 2025 22:12:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
141992025-03-25T22:12:21.288ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
142002025-03-25T22:12:21.289ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
142012025-03-25T22:12:21.289ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
142022025-03-25T22:12:21.293ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9c9b94d7-0ab6-4254-9ea2-12a5e4acffe8", "date": "Tue, 25 Mar 2025 22:12:21 GMT"} })
142032025-03-25T22:12:21.294ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "e5d54665-5903-4f01-bd06-1be7ce5784f2", "date": "Tue, 25 Mar 2025 22:12:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
142042025-03-25T22:12:21.294ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
142052025-03-25T22:12:21.295ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 450.229785ms iteration = 26 status = {}
142062025-03-25T22:12:21.296ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
142072025-03-25T22:12:21.296ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 451.790252ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
142082025-03-25T22:12:21.332ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
142092025-03-25T22:12:21.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
142102025-03-25T22:12:21.335ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a5db250-fa3f-4168-ab16-5c36568c22e2, rack_id: c7210e4b-5a81-4ec8-b8fe-816a9508dc74, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(6d5dda50-e3c4-4853-9bfa-a66b447ab351) } rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
142112025-03-25T22:12:21.335ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
142122025-03-25T22:12:21.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
142132025-03-25T22:12:21.353ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
142142025-03-25T22:12:21.354ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a7dd876d-2e8a-4a13-b639-4a654b3d82ec", "content-length": "691", "date": "Tue, 25 Mar 2025 22:12:21 GMT"} })
142152025-03-25T22:12:21.354ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
142162025-03-25T22:12:21.354ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
142172025-03-25T22:12:21.354ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
142182025-03-25T22:12:21.355ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 511.528986ms iteration = 26 status = {}
142192025-03-25T22:12:21.363ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
142202025-03-25T22:12:21.363ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "89b1cf5d-c9cb-4724-a1b0-ad062964ff6a", "content-length": "134", "date": "Tue, 25 Mar 2025 22:12:21 GMT"} })
142212025-03-25T22:12:21.363ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
142222025-03-25T22:12:21.363ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 6d5dda50-e3c4-4853-9bfa-a66b447ab351
142232025-03-25T22:12:21.364ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
142242025-03-25T22:12:21.364ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
142252025-03-25T22:12:21.364ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
142262025-03-25T22:12:21.364ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
142272025-03-25T22:12:21.364ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
142282025-03-25T22:12:21.364ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
142292025-03-25T22:12:21.364ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
142302025-03-25T22:12:21.364ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
142312025-03-25T22:12:21.364ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
142322025-03-25T22:12:21.364ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
142332025-03-25T22:12:21.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
142342025-03-25T22:12:21.366ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
142352025-03-25T22:12:21.367ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "28b904d6-0810-40f2-a4a2-219f6c48066f", "content-length": "2", "date": "Tue, 25 Mar 2025 22:12:21 GMT"} })
142362025-03-25T22:12:21.367ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
142372025-03-25T22:12:21.367ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "1572f201-bb7a-40d9-b8b2-8fa2784f11a7", "content-length": "52", "date": "Tue, 25 Mar 2025 22:12:21 GMT"} })
142382025-03-25T22:12:21.367ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
142392025-03-25T22:12:21.367ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
142402025-03-25T22:12:21.467ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8962dc93-1568-469c-ac39-c90e31db7a22", "date": "Tue, 25 Mar 2025 22:12:21 GMT"} })
142412025-03-25T22:12:21.467ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch = Switch0
142422025-03-25T22:12:21.467ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
142432025-03-25T22:12:21.468ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "92c48c87-80d3-44de-9490-de961fe2d419", "content-length": "682", "date": "Tue, 25 Mar 2025 22:12:21 GMT"} })
142442025-03-25T22:12:21.468ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
142452025-03-25T22:12:21.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
142462025-03-25T22:12:21.472ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
142472025-03-25T22:12:21.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
142482025-03-25T22:12:21.476ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
142492025-03-25T22:12:21.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
142502025-03-25T22:12:21.479ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
142512025-03-25T22:12:21.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
142522025-03-25T22:12:21.486ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 641.708579ms iteration = 25 status = {}
142532025-03-25T22:12:21.665ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3ff73be5-5b3b-4918-af48-b7fa0d50ddfe roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
142542025-03-25T22:12:21.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3ff73be5-5b3b-4918-af48-b7fa0d50ddfe resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
142552025-03-25T22:12:21.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1841 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3ff73be5-5b3b-4918-af48-b7fa0d50ddfe response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
142562025-03-25T22:12:22.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = dca87335-6a50-432e-b936-673efb60695c roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
142572025-03-25T22:12:22.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = dca87335-6a50-432e-b936-673efb60695c resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
142582025-03-25T22:12:22.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2074 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = dca87335-6a50-432e-b936-673efb60695c response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
142592025-03-25T22:12:23.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 16fa8745-74fc-4d00-b293-6903adec952e roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
142602025-03-25T22:12:23.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 16fa8745-74fc-4d00-b293-6903adec952e resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
142612025-03-25T22:12:23.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2434 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 16fa8745-74fc-4d00-b293-6903adec952e response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
142622025-03-25T22:12:24.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c89a1ea6-299d-4617-9575-e875cdea7cf1 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
142632025-03-25T22:12:24.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c89a1ea6-299d-4617-9575-e875cdea7cf1 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
142642025-03-25T22:12:24.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2176 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c89a1ea6-299d-4617-9575-e875cdea7cf1 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
142652025-03-25T22:12:25.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = eb12902f-f393-4795-93da-894a4b4c5d20 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
142662025-03-25T22:12:25.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = eb12902f-f393-4795-93da-894a4b4c5d20 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
142672025-03-25T22:12:25.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2287 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = eb12902f-f393-4795-93da-894a4b4c5d20 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
142682025-03-25T22:12:26.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d5548bba-c383-4a58-916b-75255e99b230 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
142692025-03-25T22:12:26.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d5548bba-c383-4a58-916b-75255e99b230 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
142702025-03-25T22:12:26.774ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1782 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d5548bba-c383-4a58-916b-75255e99b230 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
142712025-03-25T22:12:27.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 21264570-7093-40f8-96af-3f836c9a3838 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
142722025-03-25T22:12:27.795ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 21264570-7093-40f8-96af-3f836c9a3838 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
142732025-03-25T22:12:27.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2207 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 21264570-7093-40f8-96af-3f836c9a3838 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
142742025-03-25T22:12:28.573ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 675 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = 6905ab33-5e00-4993-bcc6-0c47026b5560 response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
142752025-03-25T22:12:28.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1ac3b3bb-55c3-4586-a0ee-e28147d47707 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
142762025-03-25T22:12:28.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1ac3b3bb-55c3-4586-a0ee-e28147d47707 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
142772025-03-25T22:12:28.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2454 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 1ac3b3bb-55c3-4586-a0ee-e28147d47707 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
142782025-03-25T22:12:29.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 098ee97f-49bb-43a8-a61c-fc2d92272ec4 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
142792025-03-25T22:12:29.838ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 098ee97f-49bb-43a8-a61c-fc2d92272ec4 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
142802025-03-25T22:12:29.840ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2391 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 098ee97f-49bb-43a8-a61c-fc2d92272ec4 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
142812025-03-25T22:12:30.844ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
142822025-03-25T22:12:30.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
142832025-03-25T22:12:30.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
142842025-03-25T22:12:30.845ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
142852025-03-25T22:12:30.845ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
142862025-03-25T22:12:30.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
142872025-03-25T22:12:30.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142882025-03-25T22:12:30.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
142892025-03-25T22:12:30.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
142902025-03-25T22:12:30.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
142912025-03-25T22:12:30.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
142922025-03-25T22:12:30.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
142932025-03-25T22:12:30.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142942025-03-25T22:12:30.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
142952025-03-25T22:12:30.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
142962025-03-25T22:12:30.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
142972025-03-25T22:12:30.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c041ff34-6269-4c95-ac88-9ffcb75bd588 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
142982025-03-25T22:12:30.859ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c041ff34-6269-4c95-ac88-9ffcb75bd588 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
142992025-03-25T22:12:30.861ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1903 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = c041ff34-6269-4c95-ac88-9ffcb75bd588 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143002025-03-25T22:12:30.868ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
143012025-03-25T22:12:30.868ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.362985ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
143022025-03-25T22:12:30.883ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
143032025-03-25T22:12:30.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
143042025-03-25T22:12:30.914ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 68.793412ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
143052025-03-25T22:12:31.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0195ed35-0e0e-40de-8b25-79c6ec809851 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143062025-03-25T22:12:31.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0195ed35-0e0e-40de-8b25-79c6ec809851 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143072025-03-25T22:12:31.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2257 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0195ed35-0e0e-40de-8b25-79c6ec809851 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143082025-03-25T22:12:32.904ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = db9da1d2-f99f-4793-9647-35ff6391c9aa roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143092025-03-25T22:12:32.904ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = db9da1d2-f99f-4793-9647-35ff6391c9aa resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143102025-03-25T22:12:32.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3226 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = db9da1d2-f99f-4793-9647-35ff6391c9aa response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143112025-03-25T22:12:33.930ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 51275d34-8b78-40dd-b376-c2ec17d1c0fb roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143122025-03-25T22:12:33.931ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 51275d34-8b78-40dd-b376-c2ec17d1c0fb resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143132025-03-25T22:12:33.933ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3238 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 51275d34-8b78-40dd-b376-c2ec17d1c0fb response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143142025-03-25T22:12:34.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ef0f6d38-c98c-438c-82eb-64e34c32b230 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143152025-03-25T22:12:34.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ef0f6d38-c98c-438c-82eb-64e34c32b230 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143162025-03-25T22:12:34.955ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2490 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ef0f6d38-c98c-438c-82eb-64e34c32b230 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143172025-03-25T22:12:35.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6f56bf4e-7ced-4233-90ef-4b3e57c5add0 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143182025-03-25T22:12:35.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6f56bf4e-7ced-4233-90ef-4b3e57c5add0 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143192025-03-25T22:12:35.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2590 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6f56bf4e-7ced-4233-90ef-4b3e57c5add0 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143202025-03-25T22:12:36.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 27555bc5-de25-4f89-ab3e-e503e0a9548b roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143212025-03-25T22:12:36.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 27555bc5-de25-4f89-ab3e-e503e0a9548b resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143222025-03-25T22:12:36.999ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2659 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 27555bc5-de25-4f89-ab3e-e503e0a9548b response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143232025-03-25T22:12:38.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8e6e1e93-334e-4a5a-af2e-0b3baf9b63a0 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143242025-03-25T22:12:38.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8e6e1e93-334e-4a5a-af2e-0b3baf9b63a0 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143252025-03-25T22:12:38.022ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2333 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 8e6e1e93-334e-4a5a-af2e-0b3baf9b63a0 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143262025-03-25T22:12:38.573ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1008 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = b5ddb5f5-f2e9-440f-affc-bb3f059b5c7d response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
143272025-03-25T22:12:39.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 07d47e19-4539-47e2-bb4d-47afa8b2bbbf roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143282025-03-25T22:12:39.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 07d47e19-4539-47e2-bb4d-47afa8b2bbbf resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143292025-03-25T22:12:39.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2441 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 07d47e19-4539-47e2-bb4d-47afa8b2bbbf response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143302025-03-25T22:12:40.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d51d5733-3b1f-4df7-a7eb-ff8240ef8f65 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143312025-03-25T22:12:40.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d51d5733-3b1f-4df7-a7eb-ff8240ef8f65 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143322025-03-25T22:12:40.065ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2263 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d51d5733-3b1f-4df7-a7eb-ff8240ef8f65 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143332025-03-25T22:12:40.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
143342025-03-25T22:12:40.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
143352025-03-25T22:12:40.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
143362025-03-25T22:12:40.845ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
143372025-03-25T22:12:40.845ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
143382025-03-25T22:12:40.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
143392025-03-25T22:12:40.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143402025-03-25T22:12:40.846ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
143412025-03-25T22:12:40.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
143422025-03-25T22:12:40.848ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.562742ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
143432025-03-25T22:12:40.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
143442025-03-25T22:12:40.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
143452025-03-25T22:12:40.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
143462025-03-25T22:12:40.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
143472025-03-25T22:12:40.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
143482025-03-25T22:12:40.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143492025-03-25T22:12:40.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
143502025-03-25T22:12:40.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
143512025-03-25T22:12:40.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
143522025-03-25T22:12:40.863ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
143532025-03-25T22:12:40.863ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.744765ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
143542025-03-25T22:12:41.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e456b2f5-db2f-4738-a54e-4a5048c88dd4 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143552025-03-25T22:12:41.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e456b2f5-db2f-4738-a54e-4a5048c88dd4 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143562025-03-25T22:12:41.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1924 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e456b2f5-db2f-4738-a54e-4a5048c88dd4 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143572025-03-25T22:12:42.106ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = edbc1be0-14e6-4b3b-b7bb-a9e9a8606b10 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143582025-03-25T22:12:42.106ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = edbc1be0-14e6-4b3b-b7bb-a9e9a8606b10 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143592025-03-25T22:12:42.108ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2370 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = edbc1be0-14e6-4b3b-b7bb-a9e9a8606b10 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143602025-03-25T22:12:43.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 72ef80bf-1ed8-412b-9030-0455e04b5b34 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143612025-03-25T22:12:43.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 72ef80bf-1ed8-412b-9030-0455e04b5b34 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143622025-03-25T22:12:43.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2131 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 72ef80bf-1ed8-412b-9030-0455e04b5b34 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143632025-03-25T22:12:44.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = db56dc2e-e668-4e42-aee5-f32b10f0c2c8 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143642025-03-25T22:12:44.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = db56dc2e-e668-4e42-aee5-f32b10f0c2c8 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143652025-03-25T22:12:44.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2355 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = db56dc2e-e668-4e42-aee5-f32b10f0c2c8 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143662025-03-25T22:12:45.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = feae4754-860c-4d75-806b-5b842ea84a2b roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143672025-03-25T22:12:45.174ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = feae4754-860c-4d75-806b-5b842ea84a2b resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143682025-03-25T22:12:45.176ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2609 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = feae4754-860c-4d75-806b-5b842ea84a2b response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143692025-03-25T22:12:46.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e4bdf090-dc77-42d5-8f39-d0392f9ee426 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143702025-03-25T22:12:46.196ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e4bdf090-dc77-42d5-8f39-d0392f9ee426 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143712025-03-25T22:12:46.197ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2229 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e4bdf090-dc77-42d5-8f39-d0392f9ee426 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143722025-03-25T22:12:47.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 671db4ac-3dac-4dbf-8d63-61b4a26458b3 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143732025-03-25T22:12:47.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 671db4ac-3dac-4dbf-8d63-61b4a26458b3 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143742025-03-25T22:12:47.221ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2369 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 671db4ac-3dac-4dbf-8d63-61b4a26458b3 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143752025-03-25T22:12:48.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 64f36f3d-fc3e-4e84-94aa-c81ec12ff720 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143762025-03-25T22:12:48.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 64f36f3d-fc3e-4e84-94aa-c81ec12ff720 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143772025-03-25T22:12:48.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2258 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 64f36f3d-fc3e-4e84-94aa-c81ec12ff720 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143782025-03-25T22:12:48.573ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 626 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = 879af08a-0a36-4d35-9768-159b5c720b06 response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
143792025-03-25T22:12:49.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 17e46200-9ddb-4077-a197-871f62d1f533 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143802025-03-25T22:12:49.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 17e46200-9ddb-4077-a197-871f62d1f533 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143812025-03-25T22:12:49.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2579 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 17e46200-9ddb-4077-a197-871f62d1f533 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143822025-03-25T22:12:50.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2eb4d2f4-64ae-48b2-acb0-699ab2a97290 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143832025-03-25T22:12:50.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2eb4d2f4-64ae-48b2-acb0-699ab2a97290 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143842025-03-25T22:12:50.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1931 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2eb4d2f4-64ae-48b2-acb0-699ab2a97290 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
143852025-03-25T22:12:50.844ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
143862025-03-25T22:12:50.844ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
143872025-03-25T22:12:50.844ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
143882025-03-25T22:12:50.844ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
143892025-03-25T22:12:50.844ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
143902025-03-25T22:12:50.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
143912025-03-25T22:12:50.844ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
143922025-03-25T22:12:50.844ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
143932025-03-25T22:12:50.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
143942025-03-25T22:12:50.844ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
143952025-03-25T22:12:50.844ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
143962025-03-25T22:12:50.844ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 26 reason = Timeout
143972025-03-25T22:12:50.844ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
143982025-03-25T22:12:50.844ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
143992025-03-25T22:12:50.844ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
144002025-03-25T22:12:50.844ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
144012025-03-25T22:12:50.844ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
144022025-03-25T22:12:50.844ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
144032025-03-25T22:12:50.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
144042025-03-25T22:12:50.845ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
144052025-03-25T22:12:50.845ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
144062025-03-25T22:12:50.845ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
144072025-03-25T22:12:50.845ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
144082025-03-25T22:12:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
144092025-03-25T22:12:50.845ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
144102025-03-25T22:12:50.845ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
144112025-03-25T22:12:50.845ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
144122025-03-25T22:12:50.845ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
144132025-03-25T22:12:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
144142025-03-25T22:12:50.845ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 26 reason = Timeout
144152025-03-25T22:12:50.845ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
144162025-03-25T22:12:50.845ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
144172025-03-25T22:12:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
144182025-03-25T22:12:50.845ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
144192025-03-25T22:12:50.845ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
144202025-03-25T22:12:50.845ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Timeout
144212025-03-25T22:12:50.845ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
144222025-03-25T22:12:50.845ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
144232025-03-25T22:12:50.845ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
144242025-03-25T22:12:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
144252025-03-25T22:12:50.845ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
144262025-03-25T22:12:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
144272025-03-25T22:12:50.845ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
144282025-03-25T22:12:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
144292025-03-25T22:12:50.845ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
144302025-03-25T22:12:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
144312025-03-25T22:12:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
144322025-03-25T22:12:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
144332025-03-25T22:12:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
144342025-03-25T22:12:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
144352025-03-25T22:12:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
144362025-03-25T22:12:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
144372025-03-25T22:12:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
144382025-03-25T22:12:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
144392025-03-25T22:12:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
144402025-03-25T22:12:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
144412025-03-25T22:12:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
144422025-03-25T22:12:50.846ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144432025-03-25T22:12:50.847ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144442025-03-25T22:12:50.847ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6924, tv_nsec: 183300410 } })
144452025-03-25T22:12:50.848ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1171
144462025-03-25T22:12:50.848ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.0136ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
144472025-03-25T22:12:50.849ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6924, tv_nsec: 184499041 } })
144482025-03-25T22:12:50.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
144492025-03-25T22:12:50.849ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
144502025-03-25T22:12:50.849ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1171
144512025-03-25T22:12:50.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
144522025-03-25T22:12:50.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
144532025-03-25T22:12:50.850ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
144542025-03-25T22:12:50.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
144552025-03-25T22:12:50.850ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144562025-03-25T22:12:50.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
144572025-03-25T22:12:50.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
144582025-03-25T22:12:50.852ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144592025-03-25T22:12:50.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
144602025-03-25T22:12:50.852ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
144612025-03-25T22:12:50.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144622025-03-25T22:12:50.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
144632025-03-25T22:12:50.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
144642025-03-25T22:12:50.854ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
144652025-03-25T22:12:50.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
144662025-03-25T22:12:50.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
144672025-03-25T22:12:50.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
144682025-03-25T22:12:50.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
144692025-03-25T22:12:50.856ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144702025-03-25T22:12:50.856ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144712025-03-25T22:12:50.858ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
144722025-03-25T22:12:50.858ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
144732025-03-25T22:12:50.858ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 13.186421ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
144742025-03-25T22:12:50.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
144752025-03-25T22:12:50.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
144762025-03-25T22:12:50.859ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
144772025-03-25T22:12:50.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
144782025-03-25T22:12:50.862ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
144792025-03-25T22:12:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
144802025-03-25T22:12:50.862ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
144812025-03-25T22:12:50.862ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6924, tv_nsec: 198032798 } })
144822025-03-25T22:12:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
144832025-03-25T22:12:50.862ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1171 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
144842025-03-25T22:12:50.863ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
144852025-03-25T22:12:50.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
144862025-03-25T22:12:50.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
144872025-03-25T22:12:50.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
144882025-03-25T22:12:50.864ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144892025-03-25T22:12:50.865ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144902025-03-25T22:12:50.866ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
144912025-03-25T22:12:50.866ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
144922025-03-25T22:12:50.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
144932025-03-25T22:12:50.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
144942025-03-25T22:12:50.868ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
144952025-03-25T22:12:50.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
144962025-03-25T22:12:50.869ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144972025-03-25T22:12:50.871ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144982025-03-25T22:12:50.874ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
144992025-03-25T22:12:50.874ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
145002025-03-25T22:12:50.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
145012025-03-25T22:12:50.876ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
145022025-03-25T22:12:50.876ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
145032025-03-25T22:12:50.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
145042025-03-25T22:12:50.905ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
145052025-03-25T22:12:50.905ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 61.26431ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
145062025-03-25T22:12:50.914ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
145072025-03-25T22:12:50.914ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
145082025-03-25T22:12:50.914ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
145092025-03-25T22:12:50.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
145102025-03-25T22:12:50.917ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
145112025-03-25T22:12:50.917ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
145122025-03-25T22:12:50.917ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
145132025-03-25T22:12:50.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
145142025-03-25T22:12:50.917ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a3762e6-055a-4bc3-a915-4656cebd51d1", "content-length": "26", "date": "Tue, 25 Mar 2025 22:12:50 GMT"} })
145152025-03-25T22:12:50.917ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
145162025-03-25T22:12:50.917ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
145172025-03-25T22:12:50.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
145182025-03-25T22:12:50.919ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
145192025-03-25T22:12:50.919ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
145202025-03-25T22:12:50.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
145212025-03-25T22:12:50.920ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 75.076432ms iteration = 26 status = {"errors":[],"requests_created_ok":[]}
145222025-03-25T22:12:50.920ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
145232025-03-25T22:12:50.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
145242025-03-25T22:12:50.920ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 75.773444ms iteration = 26 status = {"errors":[],"finish_invoked_ok":[]}
145252025-03-25T22:12:50.922ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
145262025-03-25T22:12:50.923ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 78.851977ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
145272025-03-25T22:12:50.923ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
145282025-03-25T22:12:50.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
145292025-03-25T22:12:50.924ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f034aaf6-2037-4cb4-8409-3ab31c15cc28, lookup_type: ById(f034aaf6-2037-4cb4-8409-3ab31c15cc28) } result = Ok(())
145302025-03-25T22:12:50.924ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
145312025-03-25T22:12:50.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
145322025-03-25T22:12:50.927ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 82.95838ms iteration = 26 status = 0
145332025-03-25T22:12:50.927ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
145342025-03-25T22:12:50.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
145352025-03-25T22:12:50.932ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:360
145362025-03-25T22:12:50.932ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 87.780394ms iteration = 26 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
145372025-03-25T22:12:50.933ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
145382025-03-25T22:12:50.933ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
145392025-03-25T22:12:50.933ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "89e4e87d-b89a-4989-bb50-02c2778030b2", "content-length": "26", "date": "Tue, 25 Mar 2025 22:12:50 GMT"} })
145402025-03-25T22:12:50.933ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
145412025-03-25T22:12:50.936ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
145422025-03-25T22:12:50.942ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
145432025-03-25T22:12:50.942ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 97.033335ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
145442025-03-25T22:12:50.954ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 109.761807ms iteration = 29 status = {"physical_disks_added":0}
145452025-03-25T22:12:50.962ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 117.213008ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
145462025-03-25T22:12:50.963ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
145472025-03-25T22:12:50.963ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
145482025-03-25T22:12:50.963ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
145492025-03-25T22:12:50.963ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
145502025-03-25T22:12:50.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
145512025-03-25T22:12:50.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
145522025-03-25T22:12:50.971ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 126.126133ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
145532025-03-25T22:12:50.996ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 zone_address = fd00:1122:3344:101::2
145542025-03-25T22:12:50.996ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
145552025-03-25T22:12:50.999ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7cebc212-c839-4a83-9473-7878c1836917", "content-length": "26", "date": "Tue, 25 Mar 2025 22:12:50 GMT"} })
145562025-03-25T22:12:50.999ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1184 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
145572025-03-25T22:12:50.999ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
145582025-03-25T22:12:51.011ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 166.373547ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
145592025-03-25T22:12:51.013ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
145602025-03-25T22:12:51.013ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
145612025-03-25T22:12:51.013ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 168.391282ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
145622025-03-25T22:12:51.033ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 188.595525ms iteration = 26 status = {}
145632025-03-25T22:12:51.053ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
145642025-03-25T22:12:51.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
145652025-03-25T22:12:51.055ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
145662025-03-25T22:12:51.059ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
145672025-03-25T22:12:51.059ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
145682025-03-25T22:12:51.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
145692025-03-25T22:12:51.060ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
145702025-03-25T22:12:51.063ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
145712025-03-25T22:12:51.063ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
145722025-03-25T22:12:51.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
145732025-03-25T22:12:51.137ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
145742025-03-25T22:12:51.138ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d69c2975-7f2f-40d2-959d-95393df38ad3", "content-length": "2", "date": "Tue, 25 Mar 2025 22:12:50 GMT"} })
145752025-03-25T22:12:51.139ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
145762025-03-25T22:12:51.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
145772025-03-25T22:12:51.141ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 297.165941ms iteration = 26 status = null
145782025-03-25T22:12:51.161ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
145792025-03-25T22:12:51.161ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
145802025-03-25T22:12:51.161ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a57484f8-c40c-45e1-9581-ef8c6a97d963", "content-length": "372", "date": "Tue, 25 Mar 2025 22:12:51 GMT"} })
145812025-03-25T22:12:51.161ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
145822025-03-25T22:12:51.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
145832025-03-25T22:12:51.174ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
145842025-03-25T22:12:51.175ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b5592c0-71dd-4060-ac02-20810a31b860", "content-length": "691", "date": "Tue, 25 Mar 2025 22:12:51 GMT"} })
145852025-03-25T22:12:51.175ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
145862025-03-25T22:12:51.175ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
145872025-03-25T22:12:51.175ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
145882025-03-25T22:12:51.176ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 331.99178ms iteration = 27 status = {}
145892025-03-25T22:12:51.177ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
145902025-03-25T22:12:51.177ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
145912025-03-25T22:12:51.178ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "792b0809-2135-4e2c-a9b8-f0354c2f96d1", "date": "Tue, 25 Mar 2025 22:12:51 GMT"} })
145922025-03-25T22:12:51.178ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
145932025-03-25T22:12:51.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
145942025-03-25T22:12:51.180ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
145952025-03-25T22:12:51.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
145962025-03-25T22:12:51.184ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
145972025-03-25T22:12:51.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
145982025-03-25T22:12:51.187ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
145992025-03-25T22:12:51.187ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
146002025-03-25T22:12:51.188ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e405283a-7537-46f0-ad09-b57bee9670a2", "date": "Tue, 25 Mar 2025 22:12:51 GMT"} })
146012025-03-25T22:12:51.189ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 344.922575ms iteration = 27 status = {}
146022025-03-25T22:12:51.224ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
146032025-03-25T22:12:51.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
146042025-03-25T22:12:51.226ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a5db250-fa3f-4168-ab16-5c36568c22e2, rack_id: c7210e4b-5a81-4ec8-b8fe-816a9508dc74, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(6d5dda50-e3c4-4853-9bfa-a66b447ab351) } rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
146052025-03-25T22:12:51.226ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
146062025-03-25T22:12:51.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
146072025-03-25T22:12:51.234ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
146082025-03-25T22:12:51.235ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a4473716-e9e5-4415-9635-4b0d2dbd4118", "content-length": "134", "date": "Tue, 25 Mar 2025 22:12:50 GMT"} })
146092025-03-25T22:12:51.235ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
146102025-03-25T22:12:51.235ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 6d5dda50-e3c4-4853-9bfa-a66b447ab351
146112025-03-25T22:12:51.235ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
146122025-03-25T22:12:51.235ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
146132025-03-25T22:12:51.235ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
146142025-03-25T22:12:51.235ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
146152025-03-25T22:12:51.235ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
146162025-03-25T22:12:51.235ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
146172025-03-25T22:12:51.235ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
146182025-03-25T22:12:51.235ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
146192025-03-25T22:12:51.235ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
146202025-03-25T22:12:51.235ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
146212025-03-25T22:12:51.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
146222025-03-25T22:12:51.238ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
146232025-03-25T22:12:51.238ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "51a1a50a-a83c-41f6-9a6e-e239d27430b6", "content-length": "2", "date": "Tue, 25 Mar 2025 22:12:50 GMT"} })
146242025-03-25T22:12:51.238ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
146252025-03-25T22:12:51.238ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "56f9f73a-2f87-4694-b389-aad62933415d", "content-length": "52", "date": "Tue, 25 Mar 2025 22:12:50 GMT"} })
146262025-03-25T22:12:51.238ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
146272025-03-25T22:12:51.238ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
146282025-03-25T22:12:51.338ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4691974d-fa86-43b0-ab7e-32e782ab2215", "date": "Tue, 25 Mar 2025 22:12:51 GMT"} })
146292025-03-25T22:12:51.338ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch = Switch0
146302025-03-25T22:12:51.338ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
146312025-03-25T22:12:51.339ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "809a551d-4b1d-4372-9182-e9a8c91ad8d2", "content-length": "682", "date": "Tue, 25 Mar 2025 22:12:51 GMT"} })
146322025-03-25T22:12:51.339ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
146332025-03-25T22:12:51.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
146342025-03-25T22:12:51.339ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 199e7179-aae2-4b9c-bdbf-b936d099f40d roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
146352025-03-25T22:12:51.340ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 199e7179-aae2-4b9c-bdbf-b936d099f40d resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
146362025-03-25T22:12:51.342ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2450 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 199e7179-aae2-4b9c-bdbf-b936d099f40d response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
146372025-03-25T22:12:51.343ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
146382025-03-25T22:12:51.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
146392025-03-25T22:12:51.345ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
146402025-03-25T22:12:51.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
146412025-03-25T22:12:51.347ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
146422025-03-25T22:12:51.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
146432025-03-25T22:12:51.354ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 510.281574ms iteration = 26 status = {}
146442025-03-25T22:12:52.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 59e21a7b-238f-473a-bc7b-b5a94f8dc978 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
146452025-03-25T22:12:52.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 59e21a7b-238f-473a-bc7b-b5a94f8dc978 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
146462025-03-25T22:12:52.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1800 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 59e21a7b-238f-473a-bc7b-b5a94f8dc978 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
146472025-03-25T22:12:53.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e277ba4e-ba69-4062-b39e-dfaca417b5d6 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
146482025-03-25T22:12:53.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e277ba4e-ba69-4062-b39e-dfaca417b5d6 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
146492025-03-25T22:12:53.388ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2375 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = e277ba4e-ba69-4062-b39e-dfaca417b5d6 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
146502025-03-25T22:12:54.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a7d2c645-0b66-4b21-ba5a-c216d0c5e04e roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
146512025-03-25T22:12:54.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a7d2c645-0b66-4b21-ba5a-c216d0c5e04e resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
146522025-03-25T22:12:54.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2483 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a7d2c645-0b66-4b21-ba5a-c216d0c5e04e response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
146532025-03-25T22:12:55.429ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 63984e6b-bb4c-43e1-a03a-a7d7a39644d9 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
146542025-03-25T22:12:55.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 63984e6b-bb4c-43e1-a03a-a7d7a39644d9 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
146552025-03-25T22:12:55.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2116 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 63984e6b-bb4c-43e1-a03a-a7d7a39644d9 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
146562025-03-25T22:12:56.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = cf65fe71-9072-4425-bdb8-7b910dbe1969 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
146572025-03-25T22:12:56.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = cf65fe71-9072-4425-bdb8-7b910dbe1969 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
146582025-03-25T22:12:56.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2512 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = cf65fe71-9072-4425-bdb8-7b910dbe1969 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
146592025-03-25T22:12:57.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 48efe67b-3151-46ec-9276-81d6ec2f16ed roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
146602025-03-25T22:12:57.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 48efe67b-3151-46ec-9276-81d6ec2f16ed resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
146612025-03-25T22:12:57.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2180 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 48efe67b-3151-46ec-9276-81d6ec2f16ed response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
146622025-03-25T22:12:58.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0a4a29c9-a7dc-44a8-955e-0a929e1fb01f roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
146632025-03-25T22:12:58.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0a4a29c9-a7dc-44a8-955e-0a929e1fb01f resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
146642025-03-25T22:12:58.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2390 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 0a4a29c9-a7dc-44a8-955e-0a929e1fb01f response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
146652025-03-25T22:12:58.566ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:44175
146662025-03-25T22:12:58.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44175 req_id = 741d77f2-4d98-4f04-8131-677da0c32aa1 roles = RoleSet { roles: {} } uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
146672025-03-25T22:12:58.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44175 req_id = 741d77f2-4d98-4f04-8131-677da0c32aa1 resource = Database result = Ok(()) uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
146682025-03-25T22:12:58.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2355 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44175 req_id = 741d77f2-4d98-4f04-8131-677da0c32aa1 response_code = 200 uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?sort_by=id_ascending
146692025-03-25T22:12:58.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44175 req_id = afbb9e01-a29e-46f9-b091-1fb25dfdb9a5 roles = RoleSet { roles: {} } uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
146702025-03-25T22:12:58.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44175 req_id = afbb9e01-a29e-46f9-b091-1fb25dfdb9a5 resource = Database result = Ok(()) uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
146712025-03-25T22:12:58.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2416 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44175 req_id = afbb9e01-a29e-46f9-b091-1fb25dfdb9a5 response_code = 200 uri = /metrics/collectors/ec539d60-a406-4fe9-a658-fbc8b3fb545b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTc4ZWJkNy03NmM5LTQzZjItOGQ4Yy05OWExNjQyMjRjMWMifX0%3D
146722025-03-25T22:12:58.573ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 612 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = 05c92696-5d80-4f62-8a35-7629cc0aa368 response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
146732025-03-25T22:12:59.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = fef9d752-9b95-40e6-b914-3248613d2c57 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
146742025-03-25T22:12:59.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = fef9d752-9b95-40e6-b914-3248613d2c57 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
146752025-03-25T22:12:59.519ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2488 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = fef9d752-9b95-40e6-b914-3248613d2c57 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
146762025-03-25T22:13:00.538ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f91b8f40-2068-46c1-b215-517b347b2f7d roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
146772025-03-25T22:13:00.538ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f91b8f40-2068-46c1-b215-517b347b2f7d resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
146782025-03-25T22:13:00.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1825 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = f91b8f40-2068-46c1-b215-517b347b2f7d response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
146792025-03-25T22:13:00.844ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
146802025-03-25T22:13:00.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
146812025-03-25T22:13:00.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
146822025-03-25T22:13:00.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
146832025-03-25T22:13:00.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
146842025-03-25T22:13:00.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
146852025-03-25T22:13:00.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
146862025-03-25T22:13:00.847ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
146872025-03-25T22:13:00.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
146882025-03-25T22:13:00.849ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.397157ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
146892025-03-25T22:13:00.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
146902025-03-25T22:13:00.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
146912025-03-25T22:13:00.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
146922025-03-25T22:13:00.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
146932025-03-25T22:13:00.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
146942025-03-25T22:13:00.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
146952025-03-25T22:13:00.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
146962025-03-25T22:13:00.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
146972025-03-25T22:13:00.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
146982025-03-25T22:13:00.863ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
146992025-03-25T22:13:00.863ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.90736ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
147002025-03-25T22:13:01.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 18bbcffc-9448-4363-8a5d-f0b56a2c819a roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147012025-03-25T22:13:01.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 18bbcffc-9448-4363-8a5d-f0b56a2c819a resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147022025-03-25T22:13:01.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2364 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 18bbcffc-9448-4363-8a5d-f0b56a2c819a response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147032025-03-25T22:13:02.582ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d6b26de2-da4a-4293-90d8-0b0daf070162 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147042025-03-25T22:13:02.583ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d6b26de2-da4a-4293-90d8-0b0daf070162 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147052025-03-25T22:13:02.585ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2614 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d6b26de2-da4a-4293-90d8-0b0daf070162 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147062025-03-25T22:13:03.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 56b7a5bf-2e79-4b59-a707-6ae836b8cc30 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147072025-03-25T22:13:03.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 56b7a5bf-2e79-4b59-a707-6ae836b8cc30 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147082025-03-25T22:13:03.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2355 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 56b7a5bf-2e79-4b59-a707-6ae836b8cc30 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147092025-03-25T22:13:04.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 95cde290-9022-425d-b328-41a274a96cdd roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147102025-03-25T22:13:04.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 95cde290-9022-425d-b328-41a274a96cdd resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147112025-03-25T22:13:04.628ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2485 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 95cde290-9022-425d-b328-41a274a96cdd response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147122025-03-25T22:13:05.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3eb846e5-f290-4df1-aaf2-c6bb155c302e roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147132025-03-25T22:13:05.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3eb846e5-f290-4df1-aaf2-c6bb155c302e resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147142025-03-25T22:13:05.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2429 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 3eb846e5-f290-4df1-aaf2-c6bb155c302e response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147152025-03-25T22:13:06.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2f02e0c4-94f1-4ef9-ab71-e152c4237f9e roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147162025-03-25T22:13:06.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2f02e0c4-94f1-4ef9-ab71-e152c4237f9e resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147172025-03-25T22:13:06.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2578 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2f02e0c4-94f1-4ef9-ab71-e152c4237f9e response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147182025-03-25T22:13:07.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 27e433e3-aecd-4f51-823d-0a7b1c039e17 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147192025-03-25T22:13:07.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 27e433e3-aecd-4f51-823d-0a7b1c039e17 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147202025-03-25T22:13:07.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2465 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 27e433e3-aecd-4f51-823d-0a7b1c039e17 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147212025-03-25T22:13:08.574ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 616 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = 29672968-566f-45ba-b7c7-afd6e05b9a94 response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
147222025-03-25T22:13:08.713ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a09a534d-e2f8-4b46-a230-d8de223d722f roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147232025-03-25T22:13:08.713ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a09a534d-e2f8-4b46-a230-d8de223d722f resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147242025-03-25T22:13:08.715ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2258 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = a09a534d-e2f8-4b46-a230-d8de223d722f response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147252025-03-25T22:13:09.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = acf35441-8053-4bfa-9798-7afec7cdbbc8 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147262025-03-25T22:13:09.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = acf35441-8053-4bfa-9798-7afec7cdbbc8 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147272025-03-25T22:13:09.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2281 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = acf35441-8053-4bfa-9798-7afec7cdbbc8 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147282025-03-25T22:13:10.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5e576ba3-3bb0-43a3-9117-6a1df06cb32e roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147292025-03-25T22:13:10.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5e576ba3-3bb0-43a3-9117-6a1df06cb32e resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147302025-03-25T22:13:10.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2348 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 5e576ba3-3bb0-43a3-9117-6a1df06cb32e response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147312025-03-25T22:13:10.843ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
147322025-03-25T22:13:10.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
147332025-03-25T22:13:10.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
147342025-03-25T22:13:10.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
147352025-03-25T22:13:10.845ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
147362025-03-25T22:13:10.845ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
147372025-03-25T22:13:10.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
147382025-03-25T22:13:10.847ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
147392025-03-25T22:13:10.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
147402025-03-25T22:13:10.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
147412025-03-25T22:13:10.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
147422025-03-25T22:13:10.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
147432025-03-25T22:13:10.849ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.945669ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
147442025-03-25T22:13:10.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
147452025-03-25T22:13:10.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
147462025-03-25T22:13:10.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
147472025-03-25T22:13:10.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
147482025-03-25T22:13:10.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
147492025-03-25T22:13:10.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
147502025-03-25T22:13:10.861ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
147512025-03-25T22:13:10.861ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.231838ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
147522025-03-25T22:13:11.777ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b3a2b2bb-9ebe-440d-a650-7597c1d6b7ab roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147532025-03-25T22:13:11.777ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b3a2b2bb-9ebe-440d-a650-7597c1d6b7ab resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147542025-03-25T22:13:11.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2493 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = b3a2b2bb-9ebe-440d-a650-7597c1d6b7ab response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147552025-03-25T22:13:12.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6290e8d2-a475-4c16-9e82-9f41254c5507 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147562025-03-25T22:13:12.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6290e8d2-a475-4c16-9e82-9f41254c5507 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147572025-03-25T22:13:12.800ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2273 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 6290e8d2-a475-4c16-9e82-9f41254c5507 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147582025-03-25T22:13:13.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 04e0e0e9-af06-4f5e-8e92-cc6ef477e2c6 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147592025-03-25T22:13:13.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 04e0e0e9-af06-4f5e-8e92-cc6ef477e2c6 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147602025-03-25T22:13:13.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2328 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 04e0e0e9-af06-4f5e-8e92-cc6ef477e2c6 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147612025-03-25T22:13:14.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 823a4cb4-9945-4f29-b19b-a8b24bc9a384 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147622025-03-25T22:13:14.843ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 823a4cb4-9945-4f29-b19b-a8b24bc9a384 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147632025-03-25T22:13:14.845ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2125 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 823a4cb4-9945-4f29-b19b-a8b24bc9a384 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147642025-03-25T22:13:15.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 9a222e47-df37-4e47-b4f7-ae52c2ffef95 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147652025-03-25T22:13:15.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 9a222e47-df37-4e47-b4f7-ae52c2ffef95 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147662025-03-25T22:13:15.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2555 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 9a222e47-df37-4e47-b4f7-ae52c2ffef95 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147672025-03-25T22:13:16.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2470edca-f6df-42d1-b5b5-23951ddf0346 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147682025-03-25T22:13:16.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2470edca-f6df-42d1-b5b5-23951ddf0346 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147692025-03-25T22:13:16.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2223 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 2470edca-f6df-42d1-b5b5-23951ddf0346 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147702025-03-25T22:13:17.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d31b1d21-52bf-4f8a-b5d0-52a30aec8364 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147712025-03-25T22:13:17.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d31b1d21-52bf-4f8a-b5d0-52a30aec8364 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147722025-03-25T22:13:17.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2260 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = d31b1d21-52bf-4f8a-b5d0-52a30aec8364 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147732025-03-25T22:13:18.573ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 630 local_addr = [fd00:1122:3344:101::c]:46418 method = GET remote_addr = [fd00:1122:3344:101::d]:61920 req_id = ef440f5b-fd46-4763-82e8-c70ab3dcdcb1 response_code = 200 uri = /dc04dd71-e9ce-4d94-8637-d87f47eb7409
147742025-03-25T22:13:18.929ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ebba801b-c3b5-42ce-aa88-4962cfb609e9 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147752025-03-25T22:13:18.930ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ebba801b-c3b5-42ce-aa88-4962cfb609e9 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147762025-03-25T22:13:18.932ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2303 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = ebba801b-c3b5-42ce-aa88-4962cfb609e9 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147772025-03-25T22:13:19.951ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 16b7f13d-c6b0-47e6-b0ac-eecbcadd1bfd roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147782025-03-25T22:13:19.951ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 16b7f13d-c6b0-47e6-b0ac-eecbcadd1bfd resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147792025-03-25T22:13:19.953ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2337 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 16b7f13d-c6b0-47e6-b0ac-eecbcadd1bfd response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
147802025-03-25T22:13:20.843ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
147812025-03-25T22:13:20.843ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
147822025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
147832025-03-25T22:13:20.844ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-03-25 22:03:20.843955883 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
147842025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
147852025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
147862025-03-25T22:13:20.844ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:82 reason = blueprint disabled target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7
147872025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
147882025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 18.111\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7"}
147892025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
147902025-03-25T22:13:20.844ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
147912025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
147922025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
147932025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
147942025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
147952025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
147962025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
147972025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
147982025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
147992025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
148002025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
148012025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
148022025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
148032025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
148042025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
148052025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
148062025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
148072025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
148082025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
148092025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
148102025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
148112025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
148122025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
148132025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 27 reason = Timeout
148142025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
148152025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
148162025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
148172025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
148182025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
148192025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
148202025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
148212025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
148222025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
148232025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
148242025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
148252025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
148262025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
148272025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
148282025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
148292025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
148302025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
148312025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
148322025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
148332025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
148342025-03-25T22:13:20.844ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("58d382a7-99da-40a7-bc9f-2da7e9b156c1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d42076c6-06fe-4102-a978-c7d0a8dffb98.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d42076c6-06fe-4102-a978-c7d0a8dffb98.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 6954, tv_nsec: 180120155 } })
148352025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
148362025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
148372025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
148382025-03-25T22:13:20.844ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
148392025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
148402025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
148412025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
148422025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
148432025-03-25T22:13:20.844ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5533f428-2028-4269-b7b1-f15912c01133.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("66b022b6-2e12-413e-b4b7-56c4ad5bdd77.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f337d25b-c67a-4a32-89e1-e187aea97ed9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f337d25b-c67a-4a32-89e1-e187aea97ed9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 6954, tv_nsec: 180169246 } })
148442025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
148452025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
148462025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
148472025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
148482025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
148492025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
148502025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
148512025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
148522025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
148532025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
148542025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
148552025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
148562025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
148572025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 27 reason = Timeout
148582025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
148592025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
148602025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
148612025-03-25T22:13:20.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
148622025-03-25T22:13:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
148632025-03-25T22:13:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
148642025-03-25T22:13:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
148652025-03-25T22:13:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
148662025-03-25T22:13:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
148672025-03-25T22:13:20.845ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
148682025-03-25T22:13:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
148692025-03-25T22:13:20.845ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.274722ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
148702025-03-25T22:13:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
148712025-03-25T22:13:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
148722025-03-25T22:13:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
148732025-03-25T22:13:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
148742025-03-25T22:13:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
148752025-03-25T22:13:20.845ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
148762025-03-25T22:13:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
148772025-03-25T22:13:20.845ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.299593ms iteration = 14 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
148782025-03-25T22:13:20.846ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-03-25 22:03:20.843955883 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
148792025-03-25T22:13:20.846ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 2.917141ms iteration = 14 status = {"expiration":"2025-03-25T22:03:20.843955883Z","pruned":[]}
148802025-03-25T22:13:20.846ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
148812025-03-25T22:13:20.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
148822025-03-25T22:13:20.847ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
148832025-03-25T22:13:20.847ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.544722ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
148842025-03-25T22:13:20.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
148852025-03-25T22:13:20.848ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
148862025-03-25T22:13:20.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
148872025-03-25T22:13:20.849ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
148882025-03-25T22:13:20.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
148892025-03-25T22:13:20.851ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
148902025-03-25T22:13:20.851ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
148912025-03-25T22:13:20.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
148922025-03-25T22:13:20.851ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
148932025-03-25T22:13:20.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
148942025-03-25T22:13:20.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
148952025-03-25T22:13:20.851ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
148962025-03-25T22:13:20.851ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6954, tv_nsec: 187051806 } })
148972025-03-25T22:13:20.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
148982025-03-25T22:13:20.851ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1171
148992025-03-25T22:13:20.852ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
149002025-03-25T22:13:20.852ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6954, tv_nsec: 188397799 } })
149012025-03-25T22:13:20.853ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1171
149022025-03-25T22:13:20.853ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
149032025-03-25T22:13:20.854ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
149042025-03-25T22:13:20.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
149052025-03-25T22:13:20.854ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
149062025-03-25T22:13:20.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
149072025-03-25T22:13:20.855ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
149082025-03-25T22:13:20.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
149092025-03-25T22:13:20.855ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
149102025-03-25T22:13:20.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
149112025-03-25T22:13:20.856ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
149122025-03-25T22:13:20.856ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
149132025-03-25T22:13:20.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
149142025-03-25T22:13:20.857ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
149152025-03-25T22:13:20.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
149162025-03-25T22:13:20.857ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
149172025-03-25T22:13:20.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
149182025-03-25T22:13:20.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
149192025-03-25T22:13:20.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
149202025-03-25T22:13:20.857ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
149212025-03-25T22:13:20.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
149222025-03-25T22:13:20.858ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
149232025-03-25T22:13:20.858ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
149242025-03-25T22:13:20.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
149252025-03-25T22:13:20.859ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 14.490143ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
149262025-03-25T22:13:20.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
149272025-03-25T22:13:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
149282025-03-25T22:13:20.862ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 17.592128ms iteration = 27 status = {"errors":[],"finish_invoked_ok":[]}
149292025-03-25T22:13:20.865ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
149302025-03-25T22:13:20.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
149312025-03-25T22:13:20.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
149322025-03-25T22:13:20.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
149332025-03-25T22:13:20.868ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f034aaf6-2037-4cb4-8409-3ab31c15cc28.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6954, tv_nsec: 203446582 } })
149342025-03-25T22:13:20.868ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1171 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
149352025-03-25T22:13:20.868ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
149362025-03-25T22:13:20.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
149372025-03-25T22:13:20.869ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
149382025-03-25T22:13:20.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
149392025-03-25T22:13:20.869ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
149402025-03-25T22:13:20.872ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
149412025-03-25T22:13:20.872ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
149422025-03-25T22:13:20.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
149432025-03-25T22:13:20.874ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
149442025-03-25T22:13:20.877ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
149452025-03-25T22:13:20.877ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
149462025-03-25T22:13:20.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
149472025-03-25T22:13:20.879ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
149482025-03-25T22:13:20.883ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4b417653-74b7-4fe4-8c78-4caf614b87f7, lookup_type: ById(4b417653-74b7-4fe4-8c78-4caf614b87f7) } result = Ok(())
149492025-03-25T22:13:20.883ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
149502025-03-25T22:13:20.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
149512025-03-25T22:13:20.897ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
149522025-03-25T22:13:20.900ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
149532025-03-25T22:13:20.900ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
149542025-03-25T22:13:20.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
149552025-03-25T22:13:20.908ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 63.726273ms iteration = 27 status = {"errors":[],"requests_created_ok":[]}
149562025-03-25T22:13:20.916ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
149572025-03-25T22:13:20.916ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
149582025-03-25T22:13:20.916ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 71.315596ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
149592025-03-25T22:13:20.921ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
149602025-03-25T22:13:20.922ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
149612025-03-25T22:13:20.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
149622025-03-25T22:13:20.927ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
149632025-03-25T22:13:20.927ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
149642025-03-25T22:13:20.927ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
149652025-03-25T22:13:20.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
149662025-03-25T22:13:20.927ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
149672025-03-25T22:13:20.929ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
149682025-03-25T22:13:20.930ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 85.986292ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
149692025-03-25T22:13:20.930ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
149702025-03-25T22:13:20.930ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
149712025-03-25T22:13:20.930ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
149722025-03-25T22:13:20.930ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
149732025-03-25T22:13:20.931ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
149742025-03-25T22:13:20.931ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
149752025-03-25T22:13:20.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
149762025-03-25T22:13:20.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
149772025-03-25T22:13:20.931ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
149782025-03-25T22:13:20.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
149792025-03-25T22:13:20.933ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
149802025-03-25T22:13:20.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
149812025-03-25T22:13:20.935ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
149822025-03-25T22:13:20.935ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 90.539642ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
149832025-03-25T22:13:20.935ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
149842025-03-25T22:13:20.935ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
149852025-03-25T22:13:20.935ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 91.342225ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
149862025-03-25T22:13:20.935ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 90.532831ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
149872025-03-25T22:13:20.939ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
149882025-03-25T22:13:20.939ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
149892025-03-25T22:13:20.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
149902025-03-25T22:13:20.940ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
149912025-03-25T22:13:20.940ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
149922025-03-25T22:13:20.940ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 96.011657ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
149932025-03-25T22:13:20.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
149942025-03-25T22:13:20.943ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
149952025-03-25T22:13:20.943ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
149962025-03-25T22:13:20.944ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
149972025-03-25T22:13:20.944ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 original_time_created = 2025-03-25 22:00:06.841126 UTC target_id = 4b417653-74b7-4fe4-8c78-4caf614b87f7 time_created = 2025-03-25 22:00:06.841126 UTC
149982025-03-25T22:13:20.944ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 100.391633ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4b417653-74b7-4fe4-8c78-4caf614b87f7","time_created":"2025-03-25T22:00:06.841126Z"}
149992025-03-25T22:13:20.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
150002025-03-25T22:13:20.946ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
150012025-03-25T22:13:20.946ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
150022025-03-25T22:13:20.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
150032025-03-25T22:13:20.949ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
150042025-03-25T22:13:20.949ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
150052025-03-25T22:13:20.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
150062025-03-25T22:13:20.951ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
150072025-03-25T22:13:20.955ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f034aaf6-2037-4cb4-8409-3ab31c15cc28, lookup_type: ById(f034aaf6-2037-4cb4-8409-3ab31c15cc28) } result = Ok(())
150082025-03-25T22:13:20.955ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
150092025-03-25T22:13:20.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
150102025-03-25T22:13:20.962ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 118.424889ms iteration = 27 status = 0
150112025-03-25T22:13:20.973ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = da8fd63f-278d-4a8e-9a62-fbf737f0f001 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
150122025-03-25T22:13:20.973ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = da8fd63f-278d-4a8e-9a62-fbf737f0f001 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
150132025-03-25T22:13:20.974ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
150142025-03-25T22:13:20.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
150152025-03-25T22:13:20.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3012 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = da8fd63f-278d-4a8e-9a62-fbf737f0f001 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
150162025-03-25T22:13:20.981ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
150172025-03-25T22:13:20.982ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 138.00824ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
150182025-03-25T22:13:20.983ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
150192025-03-25T22:13:20.983ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
150202025-03-25T22:13:20.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
150212025-03-25T22:13:20.985ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 141.184137ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
150222025-03-25T22:13:20.986ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
150232025-03-25T22:13:20.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
150242025-03-25T22:13:20.988ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
150252025-03-25T22:13:20.988ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
150262025-03-25T22:13:20.989ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
150272025-03-25T22:13:20.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
150282025-03-25T22:13:20.991ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
150292025-03-25T22:13:20.991ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
150302025-03-25T22:13:20.991ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 146.55926ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
150312025-03-25T22:13:20.997ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
150322025-03-25T22:13:20.997ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
150332025-03-25T22:13:20.997ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
150342025-03-25T22:13:20.997ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "188d5564-d317-4184-930b-fba1eebfe9c0", "content-length": "26", "date": "Tue, 25 Mar 2025 22:13:20 GMT"} })
150352025-03-25T22:13:20.997ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
150362025-03-25T22:13:21.000ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
150372025-03-25T22:13:21.006ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
150382025-03-25T22:13:21.007ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
150392025-03-25T22:13:21.007ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
150402025-03-25T22:13:21.007ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
150412025-03-25T22:13:21.007ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
150422025-03-25T22:13:21.007ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 96679ce4-e18c-487b-803a-7b26be55e85c dns_zone_name = oxide.test found_so_far = 0 version = 2
150432025-03-25T22:13:21.007ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
150442025-03-25T22:13:21.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
150452025-03-25T22:13:21.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
150462025-03-25T22:13:21.009ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
150472025-03-25T22:13:21.009ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
150482025-03-25T22:13:21.011ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:360
150492025-03-25T22:13:21.011ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 167.656068ms iteration = 27 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
150502025-03-25T22:13:21.013ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
150512025-03-25T22:13:21.013ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
150522025-03-25T22:13:21.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
150532025-03-25T22:13:21.014ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
150542025-03-25T22:13:21.014ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
150552025-03-25T22:13:21.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
150562025-03-25T22:13:21.015ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 96679ce4-e18c-487b-803a-7b26be55e85c dns_zone_name = oxide.test found_so_far = 1 version = 2
150572025-03-25T22:13:21.015ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
150582025-03-25T22:13:21.015ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-03-25 22:00:22.561696 UTC dns_group = external generation = 2
150592025-03-25T22:13:21.015ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 171.091468ms iteration = 14 status = {"generation":2}
150602025-03-25T22:13:21.016ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
150612025-03-25T22:13:21.016ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 23d93905-7b89-4296-b050-7ff9ae235c15 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
150622025-03-25T22:13:21.016ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
150632025-03-25T22:13:21.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
150642025-03-25T22:13:21.019ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
150652025-03-25T22:13:21.020ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1179 zone_address = fd00:1122:3344:101::2
150662025-03-25T22:13:21.020ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
150672025-03-25T22:13:21.021ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a616112b-56a8-4ae1-839e-90502be81880", "content-length": "26", "date": "Tue, 25 Mar 2025 22:13:20 GMT"} })
150682025-03-25T22:13:21.021ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1184 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
150692025-03-25T22:13:21.022ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
150702025-03-25T22:13:21.022ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
150712025-03-25T22:13:21.022ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
150722025-03-25T22:13:21.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
150732025-03-25T22:13:21.025ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 23d93905-7b89-4296-b050-7ff9ae235c15 dns_zone_name = control-plane.oxide.internal found_so_far = 52 version = 1
150742025-03-25T22:13:21.025ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
150752025-03-25T22:13:21.025ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-03-25 22:00:21.368103 UTC dns_group = internal generation = 1
150762025-03-25T22:13:21.025ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 181.45925ms iteration = 14 status = {"generation":1}
150772025-03-25T22:13:21.031ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-03-25T22:00:16.382271Z, time_modified: 2025-03-25T22:00:16.382271Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, db_silo: Silo { identity: SiloIdentity { id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-25T22:00:22.501108Z, time_modified: 2025-03-25T22:00:22.501108Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, db_silo: Silo { identity: SiloIdentity { id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-25T22:00:22.501108Z, time_modified: 2025-03-25T22:00:22.501108Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d" }] }) }
150782025-03-25T22:13:21.031ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 187.089388ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"5c35ff8c-21dd-48b9-9751-76bfa681bc38","tls_certs":["0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d"]}},"default_endpoint":{"silo_id":"5c35ff8c-21dd-48b9-9751-76bfa681bc38","tls_certs":["0c1d4a11dcda647c9ac35240fe60a5fbe2d85754352dd89878e2a5fb0f756d6d"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
150792025-03-25T22:13:21.040ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
150802025-03-25T22:13:21.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
150812025-03-25T22:13:21.042ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
150822025-03-25T22:13:21.044ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
150832025-03-25T22:13:21.044ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
150842025-03-25T22:13:21.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
150852025-03-25T22:13:21.046ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
150862025-03-25T22:13:21.048ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
150872025-03-25T22:13:21.048ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
150882025-03-25T22:13:21.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
150892025-03-25T22:13:21.099ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 254.956263ms iteration = 30 status = {"physical_disks_added":0}
150902025-03-25T22:13:21.133ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
150912025-03-25T22:13:21.135ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
150922025-03-25T22:13:21.135ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 291.009344ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
150932025-03-25T22:13:21.158ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 zone_address = fd00:1122:3344:101::2
150942025-03-25T22:13:21.158ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
150952025-03-25T22:13:21.159ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2141628c-56de-42df-8890-d694108f4067", "content-length": "26", "date": "Tue, 25 Mar 2025 22:13:20 GMT"} })
150962025-03-25T22:13:21.159ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1184 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
150972025-03-25T22:13:21.160ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1219 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
150982025-03-25T22:13:21.192ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
150992025-03-25T22:13:21.192ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d543a3e-49e0-460b-960d-d79cfe7eb3c1", "content-length": "2", "date": "Tue, 25 Mar 2025 22:13:20 GMT"} })
151002025-03-25T22:13:21.194ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
151012025-03-25T22:13:21.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
151022025-03-25T22:13:21.196ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 352.472637ms iteration = 27 status = null
151032025-03-25T22:13:21.226ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
151042025-03-25T22:13:21.279ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 435.62585ms iteration = 27 status = {}
151052025-03-25T22:13:21.307ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
151062025-03-25T22:13:21.308ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "99f15d43-b055-4693-89d9-c275041c79b5", "date": "Tue, 25 Mar 2025 22:13:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
151072025-03-25T22:13:21.308ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
151082025-03-25T22:13:21.310ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "dc917da1-87a0-4e7c-9e2c-278c2b35d787", "date": "Tue, 25 Mar 2025 22:13:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
151092025-03-25T22:13:21.310ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
151102025-03-25T22:13:21.312ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
151112025-03-25T22:13:21.312ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 468.2258ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
151122025-03-25T22:13:21.358ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
151132025-03-25T22:13:21.358ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
151142025-03-25T22:13:21.358ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "543518d9-8216-4d2e-9388-be52656122a0", "content-length": "372", "date": "Tue, 25 Mar 2025 22:13:21 GMT"} })
151152025-03-25T22:13:21.358ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
151162025-03-25T22:13:21.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
151172025-03-25T22:13:21.372ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
151182025-03-25T22:13:21.373ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "640a1e2b-0bb4-4a51-b866-f04c6cd91011", "date": "Tue, 25 Mar 2025 22:13:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
151192025-03-25T22:13:21.373ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
151202025-03-25T22:13:21.374ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
151212025-03-25T22:13:21.374ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "f518203a-2f9a-4777-95fa-e3fe62eda9fb", "date": "Tue, 25 Mar 2025 22:13:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
151222025-03-25T22:13:21.374ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
151232025-03-25T22:13:21.374ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "65b80599-5464-4195-ac39-c577fc3f9c44", "content-length": "691", "date": "Tue, 25 Mar 2025 22:13:21 GMT"} })
151242025-03-25T22:13:21.374ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
151252025-03-25T22:13:21.374ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
151262025-03-25T22:13:21.374ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
151272025-03-25T22:13:21.376ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "450561f4-4e41-4a4b-97da-5c5b0e5f34ff", "date": "Tue, 25 Mar 2025 22:13:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
151282025-03-25T22:13:21.376ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
151292025-03-25T22:13:21.376ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 532.697245ms iteration = 28 status = {}
151302025-03-25T22:13:21.380ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
151312025-03-25T22:13:21.380ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 536.592004ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
151322025-03-25T22:13:21.409ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
151332025-03-25T22:13:21.409ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
151342025-03-25T22:13:21.409ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "43a7bafc-87a0-42ac-bd22-466c2ff86728", "date": "Tue, 25 Mar 2025 22:13:21 GMT"} })
151352025-03-25T22:13:21.409ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
151362025-03-25T22:13:21.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
151372025-03-25T22:13:21.412ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
151382025-03-25T22:13:21.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
151392025-03-25T22:13:21.416ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
151402025-03-25T22:13:21.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
151412025-03-25T22:13:21.421ZINFOnexus (BackgroundTasks): VPC route manager sled f034aaf6-2037-4cb4-8409-3ab31c15cc28 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
151422025-03-25T22:13:21.421ZDEBGnexus (BackgroundTasks): client request SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
151432025-03-25T22:13:21.421ZDEBGnexus (BackgroundTasks): client response SledAgent = f034aaf6-2037-4cb4-8409-3ab31c15cc28 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d9242666-b495-4a7a-b551-9b00edb142f9", "date": "Tue, 25 Mar 2025 22:13:21 GMT"} })
151442025-03-25T22:13:21.423ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 578.80506ms iteration = 28 status = {}
151452025-03-25T22:13:21.430ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
151462025-03-25T22:13:21.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
151472025-03-25T22:13:21.433ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a5db250-fa3f-4168-ab16-5c36568c22e2, rack_id: c7210e4b-5a81-4ec8-b8fe-816a9508dc74, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(6d5dda50-e3c4-4853-9bfa-a66b447ab351) } rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
151482025-03-25T22:13:21.433ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
151492025-03-25T22:13:21.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
151502025-03-25T22:13:21.443ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
151512025-03-25T22:13:21.443ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "36f3504f-1b95-4ad3-bdfe-6ea673eab9b2", "content-length": "134", "date": "Tue, 25 Mar 2025 22:13:20 GMT"} })
151522025-03-25T22:13:21.443ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
151532025-03-25T22:13:21.443ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 6d5dda50-e3c4-4853-9bfa-a66b447ab351
151542025-03-25T22:13:21.443ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
151552025-03-25T22:13:21.443ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
151562025-03-25T22:13:21.443ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
151572025-03-25T22:13:21.443ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
151582025-03-25T22:13:21.443ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
151592025-03-25T22:13:21.444ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
151602025-03-25T22:13:21.444ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
151612025-03-25T22:13:21.444ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
151622025-03-25T22:13:21.444ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74
151632025-03-25T22:13:21.444ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
151642025-03-25T22:13:21.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
151652025-03-25T22:13:21.446ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
151662025-03-25T22:13:21.447ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "603dc5a8-d99f-4a42-84cb-daf883057614", "content-length": "2", "date": "Tue, 25 Mar 2025 22:13:20 GMT"} })
151672025-03-25T22:13:21.447ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
151682025-03-25T22:13:21.447ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "78d6e46e-92be-4ae9-88f5-f42e2cb667ce", "content-length": "52", "date": "Tue, 25 Mar 2025 22:13:20 GMT"} })
151692025-03-25T22:13:21.447ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch_location = Switch0
151702025-03-25T22:13:21.447ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
151712025-03-25T22:13:21.548ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1084d871-1098-4db2-8cb2-f4508dbfa0d9", "date": "Tue, 25 Mar 2025 22:13:21 GMT"} })
151722025-03-25T22:13:21.548ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 switch = Switch0
151732025-03-25T22:13:21.548ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
151742025-03-25T22:13:21.549ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c7210e4b-5a81-4ec8-b8fe-816a9508dc74 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c7f2809-0e2a-45ab-8966-861b0959dbee", "content-length": "682", "date": "Tue, 25 Mar 2025 22:13:21 GMT"} })
151752025-03-25T22:13:21.549ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
151762025-03-25T22:13:21.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
151772025-03-25T22:13:21.553ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
151782025-03-25T22:13:21.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
151792025-03-25T22:13:21.557ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
151802025-03-25T22:13:21.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
151812025-03-25T22:13:21.560ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
151822025-03-25T22:13:21.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
151832025-03-25T22:13:21.567ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 723.315185ms iteration = 27 status = {}
151842025-03-25T22:13:22.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 47d454a3-e9a8-453d-b00b-0dc7930b1652 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
151852025-03-25T22:13:22.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 47d454a3-e9a8-453d-b00b-0dc7930b1652 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
151862025-03-25T22:13:22.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2504 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 47d454a3-e9a8-453d-b00b-0dc7930b1652 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
151872025-03-25T22:13:23.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 001517ca-0d2b-46ca-8fea-eaa256c8be08 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
151882025-03-25T22:13:23.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 001517ca-0d2b-46ca-8fea-eaa256c8be08 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
151892025-03-25T22:13:23.024ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2661 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = 001517ca-0d2b-46ca-8fea-eaa256c8be08 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
151902025-03-25T22:13:24.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = fe4e6263-6504-41ae-b1a4-2b2fe21b5e98 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
151912025-03-25T22:13:24.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = fe4e6263-6504-41ae-b1a4-2b2fe21b5e98 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
151922025-03-25T22:13:24.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2337 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = fe4e6263-6504-41ae-b1a4-2b2fe21b5e98 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
151932025-03-25T22:13:25.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = cb7d5222-10bc-4b02-887c-500bd4a72e60 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
151942025-03-25T22:13:25.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = cb7d5222-10bc-4b02-887c-500bd4a72e60 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
151952025-03-25T22:13:25.069ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2670 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = cb7d5222-10bc-4b02-887c-500bd4a72e60 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
151962025-03-25T22:13:26.089ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = fef16292-4909-4e47-b633-cfa5f5474c27 roles = RoleSet { roles: {} } uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
151972025-03-25T22:13:26.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = fef16292-4909-4e47-b633-cfa5f5474c27 resource = Database result = Ok(()) uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28
151982025-03-25T22:13:26.092ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2913 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57063 req_id = fef16292-4909-4e47-b633-cfa5f5474c27 response_code = 200 uri = /probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28